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• » This report is submitted to the, Natioqal, Assessment of Educatiodal 
Progress (NAEP) and constitutes . the final report for assessment Year 11. 
'The report covers in-school and supplementary frame sampling ac£ivities in 
the eleventh operational year of .Natiohai Assessment. Out-of^chool sampl- 
. ing activities for Young Adults were not carried out during Year'll because 
Of reduced funding. 5 
^•^ Overall National Assessinent Oblectives 

The ^^ong-term objective of the National Assessment of Educational 
Progress is to assess the progress of education of selected' population 
groups. This objective" hafe required the devel^pmfent and implementation of 
a continuing program of data collection, analysis , and reporting.' 
, .The immediate products, of the National Assessment program are statisti- 
cal data series describing the knowledge, skills, and attitudes of selected' 
population groups. A stated objective of National Assessment has been to 
present edncatioqal outcijme data which may' be readily understood by the lay. 
I^^ublic as.weli ^s b|^||^ssional researchers, educators, and legislators. 
- This has brought .^boilrva departure from traditional edbcational measurement 
procedures which a're directed toward' individual performance on a battery of 
exercises. The National Assessment data are- used to present estimates of 
population group 'performance • on specific exercises. This shift in the 
method .of data acquisition and presentation has required development of 
. unique sample selectiop, . data collection, and analysis procedures. 

The National Afsessment program has focused on major population sub^ 
groups and oS specified subject matter areas. The special populations' 



targeted by National Assessment are restricted to fout.age classes (1,2,3, 
and 4): g-year-olds', .13-year-olds, 17-year-old&, and . young adults (26-35 
ye'ars of age), respectively. Nine year-old,s, 13-year-olds, and l7-year- 
ol4s are assessed in school. In*addition, 17-year-olds no longer enrolled 
in school are assessed in their homes, as are young adults. The assessment 
of young adults was suspended in Year 06, and w^s resumed as a separate 
undertaking inVhar 08 only. Additionally, the assessment of out-of-school 
17-year-olds was. suspended in Year 08, and not resumed until Year 11. 
Other population subgroups ca*^n be defined within each age class (e.g., 
region^ sex, race, level of parents* education, and community type); these 
subgroups are discussed in some detail in section 1.3. 

The subject ' matter areas assessed through Year 11 have included: 

Year 01 - Science, Citizenship, aad Writing; 

Year 02 - Reading and Literature; 

Year 03 ^Music and Social Studies; 

Year 04 - Mathematics and ^he reassessment of Science; 

Year 05 - Career and Occupational Development and the reassessment of " 
Writing; 

Year 06 - Art and the reassessment of Reading; 

Year 07 - Basic Mathematics and the reassessment of Citizenship and 

Social Studies (combined); 
Year 08 - Reassei^sment of Science at all age classes; assessment of 

Health and Energy and reassessment of Iteading at Age Class 4; • 
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# Year 05 out-of-school assessment/^ included Cs^reer. and Occupational 
Development only. 

In Year 07, Basic Mathematics exercises wer^ administered to 13- and 
9^ 17-year-olds only, ' . . ^ 



r M,*K4.mati rs at all iii-school age classes; 
Year 09 - Reassessment iof Mathematics at aii in 6 . 

Year 10 - J^eassessment of Music. Art, and Writing; 
Year 11 - Reisseisment of Reading, Literature, and Art . 
,I„ Tears 05 %i 06, supplemental Hini-Ass=ss»ents of Fwtional 
Literacy (MATL) -ere also conducted for H-year-olds. .In Year 06. Index of 
Basic Skills packages •we're additionally administered to H-year-olds; in 
Year 08. B„ic Life SkiiU Vackages were administered to 1,-year-olds, in 
Year 09. ,7-year--olds>ere»asse«^in Consumer Skills, and in Year 10. 
A«itude. and Ackieve-m^t in Hathematics packages were additionally admin- 
istered to 13-year-olds and twelfth graders. 
1.2 Historical Overview of Nati onal Assessment 

National Assessment has undergone a mild evolution over the period of 
its brief 'history^. ' 'special adjustments in sampling and field procedures 
have been made eviry year-^accommodate the special requirements of exer- 
cise ad.in^stration in new sulject matter areas. The sampling of 17-year- 
olds not enrolled .in school sTiifJ^d from a household sample approach to a 

rv, to a -school dropout and early graduate frame 
rtultfiplA^Jrame . approach to a scnooi ^ v 

Ik 

L ^ f-it-ci- f-ive vears of assessment, 

approach over the Jirst iive ycdia 

i Year 01, TT-year-olds not enrolled in school were located in the 

household sample oni;. The sample of „.t-of-school 17-year-old. is called 
the Suppleme'ntary Frame sample. . Several potentfal methods" of obtaining 
list, of out-of-.chool 17-ye.r-old. were investigated before the Year 05 
procedure was finalized. Some of these potential list, included an area 
•household "fra,.. secondary school records, colleges, military service 
inductioi, center.,. Neighborhood Youth C«rp. , Job Corp., and the Employment 
Securltr Co^ais.ioa. In V,.r 05, the deci.ion wa. made to obtain early 



*ln Tear. 11,- Art ex.rci." were administered to 13-year-olds only. 
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graduate and dropout lists from a subsample of the schools selected "for 

17-year-old assessment. The examinations, of these potential lists are ^ 

documented elsewhere [1], [2], *s * 

A number of modified field procedures were initiated iti the\Year 02 

out-of-s<rtiool assessment' as a result of the Year 01 experience. The require- *' 

•ment of including all States in the in-school sample necessitated maoor * ' 

sample design -changes in Year, 02; further sample design modifications were 

instituted in Year 05 to meet this requirement end also provide simple, 

relatively unbiased metkods of- estimating sampling error(^ 

In Year (^4, a study to align National Assessment sample stratification 

more close^ly with NAEP reporting categories was undertaken. Some valuable 

by-products -of this study >ncluded* (l) the definition /of Census low-income 

areas as a stratification tool to isolate the low metropolitan subpopula- 

tion, (2) the use of Census estimates of the percent rural 17-year-olds to 

ft 

define the extreme rural subpopulations,, and (3) the development of a 
standardized seit of procedures, including computer software, to classify 
respondents into size and type of community reporting categories. - 

^ The Year 06 assessment included a number of experimental studies of 
alternate meth<As of " administration, which had an impact on how field 

procedures were conducted as part of the l7-year-9ld assessment.^ One study 

^ ' \ 1 \ 

explored the operational^ feasibility of a modified student selection proce-^ 

dure. As a result of this substudy, it was d'ecided to modify the student 

selection procedure in Year 07 from a systematic sample to a* simple, random 

sample. Additionally, the simple random sampling approach allpwed school^ 

to use pre-existing lists of eligibles (i.e., computer printouts, classroom 

rosters) to the fullest extent. A second feasibility study conducted in * 

Year 06, involving a subsample of 48 schools, tested three different package 
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.^inutratio. pUn. desisnrf to Increase the nu„b» of respondents without 
the us. .of slternates. This study w.s crried out Vs . statistical!, valid 
'■experWal design .so the response rates and..ost factor, could be 
co^ared an; any observed difference could be evaluated against the experi- 
„„t.l error.' « a result -.f this substudy, a procedure to f.llowup non- 
tespondents ^n the day after package administration was adopted in Year 07. 

A nu.ber of ■ .ore, formal self-evaluation projects have been conducted. 
These projects included sa^le efficiency studies, a quality check resurvey 
"of th. household sa^le in Year 01, and a foUowup study of nonresponding 
in-school 17-year-olds in Year 04. Beginning in Year 04, the quality of 
"the collected data hts' been assessed through annual probability samples of- 
school..* Following the Years 06, 07, and 08 assessments, NAEP and RTI 
held a District Supervisors debriefing conference to obtain reco-endations 
for future National Assessment years. Meet».gs of this type supply valuable 
■ ' insight to' planning subsequent assessnents. 

'Tdditlonally, in Year 06 RII participated with NAEP. in developing a 
,' coordinated four-year school san^ling design which achieved broad dispersion 
Of the sample over the four-year period', yet avoided many of the problems 
encountered in the past when . the same schools were selected in successive 
years through independent annual samples. The proposed design also reduced 
tie number of travel poi/t. in any single year', sample. This change was 
'„tivated by the reduced funding., level and associated reduction in package 

^- • t-^A fni- <:ubseauent assessments. Cost and 
administration loads anticipated for suDsequenc 

variance analyses, indicated that such , reduction -in primary san^ling 
'.points would icnprovft^design efficiency . Reducing the number of travel 



*Becau..' of cost considerations, a nonprobability sac^ple of schools was 
. <e3cainiac<l in Year 05. ' ^ 
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points became a viable option as a re.ult of the relaxation of the all-state 
representation requirement in Year 07, / - 

/ • two de.ig. „odific3tioas vere adopted in Tear 07. _ First, a .uUista.e 

'reallocatioa procedure based oa the school fr,»e data vas adopted. The 
procedure reassisne^ the replicates ia Tear 07 to PS>is proportional to 
■ re«.ed 17-year-old size measures based on estimated 17-year-old school , 
enrol lireTtV developed' from the school frame. 

■ Secondly, in Tear.07 a ranking of schools based on parents' occupation 
and DOC classification was .ade prior to package assignment. This ranking 

■' - i.j ...h.fratuni within each PSU. The group 

WIS used to identify the oversappled substratum witni 

package sample size' for each oversampled and nonoversampled school within 
each substratum- was then determined from ^ge class enrollment estim^ies on 

A fr-'r,m nrgViouslv computed student response 
Principal's Questionnaires and from previously c v 

rate, by size and type of co»unity. This procedure allowed adjustments to 
be mad. for schools which, at sample selection, «r1.ave'been misclassified 

into the )>'versampled substratum. 

ThreV. addition^ design modifications were incorporated in Tear 08. 
First, the 17-year-.ld student samples were selected in a PSU at the same 
time that the 9-year-old student samples' were selected. Nine- and sevente^ 
year-old respondents we« assessed, at the usual time; however, the new 
. procedure eliminated some of the school burden by giving ,7-year-old schools 
more time to prepare for 'assessment. 

secondly, student sample weights were e,uaUzed separately within the 
oversa»pled s'ub.tiatum ,nd within the remainder at the, student selection 
■' level by varying the sample size. 'Group sample sizes ranged. from 10 to 35. 

Thirdly, the Tear 08 Quality Check sample was selected across all 
■three age cla^e..' Previously only school, at a p.rticul.r age class had 



Wen includes in. the quality check sample each year. This new procedure 
enabled ^RTI's National Assessment Administration Center to detect more 
, rapidly any I'rregularitips in the collection of National Assessment data. 
A^ a., result of recommendation from the District Supervisor's debriefing 
conference, th^maximum group sample size" in Year 09 was reduced from 35 to' 
25 students. Similarly, the minimum was increased from 10 to I6.^xpected 
saii5)l«i weight sums and sample sizes for various maxima and minima were 
examined prior to the decision. It was found that the maximum group size 
could be reduced without appreciably altering the targeted sample size 
while still equalizing the sample weights. 

In Year 10, the method of estimating the number of eligibles per 
- school was refined. Previously, e^Ugibles were estimated using the school 
grade by grade enrollment and 1970 ' estima ties of the proportion of eligibles 
per grade in each State. Using the Year 09 response data and i'rincipal's 
Questionnaire data, regression equations were developed in Year 10 to 
predict estimated eligibles by school. for each age class. 

In Year *11, a coordinated four-year primary sample was selected. The 
sample was selected in March 1979 and was priceetied by an 18-month planning 
effort. During th»^planning period, primary designs from the first ten 
years were eitamioed iif terms of strengths and weaknesses, design efficiency 
studies conducted in Year^^? were re-examined, and the direction of the 
sample over the next four years was discussed. The sampling procedures are 
doQumented elsewhere 13}. ■ 
1 .-3" Subpopula-tion Representation 

National Assessment reports results for a variety of subpopulations . 
Beside* the three' in-school age groups, 'reported subpopulations include 
within eich a^e level four g?ographi<- regions, sex, race, grade, foui 

^20 ■ " 



levels of parents' education, and seven^^iz^ and type of community <STOC) 
categories. These reporting groups are listed in table 1-1. 

The geographic regions referred to {n taTle 1-1 are those used by the 
Office of Business Economics, Departinent of Commerce.. Table 1-2 defines 
NAEP's regions in terms of the'set^ of 'States which comprise the four 
geographic areas. 

The size- and type of community categorization mentione.d^in table, l-f 
refers to a postclassif ication of schools in terms of the residential 
distribution and parental occupation of attending students. A detailed 
description of ' tbe STOC classification procedures is presented in section 



2.6. 



A major objective of . the National Assessment . su-rV^y design is to 
- guarantee adequate sample represez^tati^ fox- the reporting subpopulations 
listed in table 1-1. Such representatin • is essential if reasonably precise 
ci-parisons among these subpopulations are to be .n^de within a given assess- 
ment year and with previous y^ars when the same subject areas were assessed. 
Overview of Sampliiife Activi tifK 

♦ 

Sampling activities for Year 11 'began in 1977 w^n plans were, begun 
for the selection of a coordii^ated four-year primary "sample to be allocated 
to Years. 11-14." In' March, 197r the sample' was selected and allocated. 
In-school. secondary sample selection activities were carried out- during May 
thVough August, 1979, and in-school package assignment and field support 
activities were begun in August and continued into 1980,. ?ample weight 
coiiputation activities b^n in January «,d continued through August 1980. 
The Supplementary Frame secondary sample was selected in July and August 
1979, and the third-stage sample^ of discontinuers and early graduatls was 
-.elected during March through May 1980 and administered 'in June throtigh 



r 
r 
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Table 1-1. National Assessment reporting categories 



Classification 




y 'Level of parental 



education 



Size and type^ of 
community (STOC) 



Grade 



Number of 
subgifoups^ 



3 
2 
4 
4 



Subgroup names^ 



9-, 13-, 17-year-olds 
Male, Female 

White; Black, Hispanic, Other 

Northeast, Southeast, Central, 
West 

No high school 
Some high school 
Graduate high school 
Post high school 

Low metropolitan (extreme inner 
city) 

High metropolitan (extreme 

affluent suburb) 
Extreme rural 

Main big city (remainder of 

big city) 
Urban fringe (suburban fringe) 
Medium city 
.^..Small places (small city) 



3 (9*s, 13'8) 3,4, Othet 

7,8, Othef 

4 (17's) I0,ll,li, Other 
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Table ,1-2. 



Pefinitions of Nati^j^aJ Assessment* regional subpopulations 



Northeast 

Delaware 

Connecticut 

Maine 

Nfcw Hampshire 
Rhode Island 
Vermont ^ 
District of Columbia 
Maryland 
Massachusetts 
New Jersey 
Pennsylvania 
New York 



\ 



Central 



\ 



Iowa 
Kazf#as 

Nebraska 

Notth Dakota 

South Dakota 

Minnesota 

Missouri 

Illinois 

Indiana 

Michigaa 

Wisconsin 

Ohio 



i 



J 



Southeast 

Arkansas 
Florida 
Virginia r 
West Virginia 
Alabama 
Georgia 
Kentucky 
X'OUisiana 
Mississippi 
North Caroling 
South Carolina 
Teonessee 



Wes 



uessee 
t / 



Ai^aska 

Hawaii 

Idaho 

Montana 

Nevada 

Wyoming 

Arizona 

Oregon 

Utah 

Colorado 

New Mexico 

Oklahoma 

California 

Texas 

Washington 
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August, Supplementary Frame weights were computed in September through 

J, 

November 1980. 

1 »5 Report Organization 

Chapter 2 of/ this report documents the Year 11 in-school sampling and 
'^weighting activities. Supplementary Frame activities are described in 
Chaptet 3. A list of references is included at the end of each chapter. 
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2. IN- SCHOOL ASSESSMENT 



2,1 lDtro(juction 

» -. • 

The subject areas assessed in Year 11 were Reading, Literature, and 
Art.' Reading and Literature had ^^en previously assessed in Year 02, and 
Reading had been reassessed in Year 06, A^'t had been assessed in Ye^r 06 
and reassessed in Year 10, Year * 11 Art ^exercises were administered to 
13-year-oXds only. ^Table 2-1 summarizes the njiimber of Year 11 packages by 
age class and type of package. Planned sample sizes by class ^are shown 
in table 2-2. . ' • 

2.1.1 Tayget Population ' i^ 

The target population specified for in-school assessment include^ 
9-year-olds, 13-year-oltis , and 17-year-olds enrolled in either public or 
private schaols at ahe time of assessment. Table 2-3 presents the specific 
age definitions prescribed for assessment Year 11 ai>d, the range of a^e for 
eligibles ii^ the school sample. ' 

The target populations defined by birthdate ranges in table 2-3 were 
restricted by excluding persons who were functionally handicapped to the 
extent that they could not participate in the assessment as it was normally 
conducted. Specific groups excluded were: , ^ » 

(1) Non-English speaking persons; 

.(2) Respondents identified as nonreaders during the assessment; 

(3) Persons^ physically or mentally handicapped, including Educable 
Mentally Retarded (EMR) , in such a way that they could not res- 
If6nd to NAEP exercises as they were normally administered; 

(4) Students attending public ant} private scfhools established for the 
physically handicapped and/or mentally ret,arded. 

In addition to these groups Vhich were judged incapable of responding 

properly, 9- and 13-year-olds not enrolled in public or private schools at 
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Table 2-1. Jejr 11"* ip-school NAEP packages by age class 
and type of package * 

-2 at ' 



T 



Age^^ass Reading and Literature Reading, Literature, and Art 



• 0 



1 O-year-olds) n _ J 

^2^(l3-year-ol-ds) * V - 14 1 " 

3 (17-year-olds) U ^ " - 



Tabier-2-2. Planned sample sizes by age class 



Sample • Total 
- . . Number . size/ sample 

Age' class lof- packages papfcage size 



1 O-year-olds) * . 2,592 28,512 

2 (13-year-olds) 15 2,592 38,880 . 
^ 3 (17-year-old8) ■ • 2,592 36,288 



initic 



Table -2-3- ."Definitions of target populations 
range of age for eligibles 



f 



Eligible birthdates 



Age gtoup 



Survey period 



9-year-oJ^8 
IS-year-olds 
17-year-olds 



1/02/80 to 3/02/80 
10/09H|9 to 12/15/79 
3/05/80 to 5/04/80 



Calenda^^ year 1970' 
Calendar year 1966 
10/01/62 to 9/30/63 



^ Eligible^ age range 



Minimum 



Mid-range 



Maximum 



9-year-olds ^ 
13-year-olds 
17-yeaf-olds 



9 yrs. 1 mo. 
12 yrs. 9^ mos. 
16 yrs. 6 mos. 



9 yrs . 7^ mos . 
13 yrs. 4^ mos. 
17 yrs. h n»o. 



10 yrs . 2 mos . 

« 

13 yrs. 11^ mos. 
17 yrs. 7_mos. 
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the time of assessment were excluded. Out-of-school 9- and 13-year-olds 
represent such a small fraction of their respective age groups that it was 
not worthwhile to pursue them. Other general NAEP sample design specifica- 
tions are Mentioned in the following paragraphs. 

f 

2.1.2 Sample Design Objectives 

The following were the tnajor objectives of the four-year sample design 
implemented beginning in Year 11: 



(1) Insure that at least one '*SU was present in ea^r^egion by size 
of community category annually. 

(2) Reduce the geographic size of PSUs. 

0) Redefine sampling size of community stratification to more closely 
^ align with reporting size and type of community definitions. 

(4) Wersample low income a n'ST extreme rural areas to insure adequate 
Sample representation for the reporting subpopulations . 

(5) Insure that a school would appear in the sample nO more than once 
every four years^ 

(6) ' Facilitate simple and relatively unbiased estimates of sample 

variance. 

(7) Permit samples . of either (a) 75 PSUs with 550 schools at each age 
l^el or (b) 100 PSUs with 1000 schools at each age level^ 

2.2 Priaary Sample ■ ^ 

To achieve .the major objectives stated in section 2.1.2, a four-year 
primary sample was^ designed and implemented. The primary sample selection 
was co^leted in March 1979 and aocumented in a separate final report to 

ECS 111. X ' . 

Counties and 1970 Census-redognized county-equivalent independent 
cities f^or clusters of these, comprised the primary sampling frame. Twenty 
oajor strata were defined by crossing the four geographic regions with five 
sampling, description of community (SDOC) . levels. The five SDOC categories 
are defined as follows: 



20 



SDOC ' DennitioD 



1 SHSA Counties containing^ all or part of a central city of 
200^000 or more population ("big city") in 1970. 

2 RelDaining counties in "big city" SMSA's. 

' '^^ / 

3 Other count||||g containing all or part of a place with 
25^000 or more population in 1970. 

Aunties not qjLalifying for SDOC 1, 2, or 3 and not 
classified as "extreme rural" (SDOC 5). 

V 

5 ^ Counties not clas^sif ied^as SDOC 1, 2, or 3, not having 

10,000 or more total 1970 urban population, having non- 
zero farm employment, and having relatively high values 
o£Jan "extreme rural" 'index, computed based on county 
abor force occupational classifications. 



The allocation of a one year sample of 162 replicates in proportion to 
a measure of size for each region by SDOC stratum is shown in table 2-4. 
The size measures shown is the average number of 9-, 13-,^ and 17-year-olds, 
counting children in inner cities and extreme rural areas tWice, 

Within each region by SDOC stratum, the desired iateger sample alloca- 
tion was configured into an allocation of 1-, 2-, and 3-replicate sample 
upits^^^:»«sho%m by table 2-5. For example, in region 1 and SDOC 1, .l;he' 
thirteen allocated replicates were partitioned into five 2-replicate units 

n 

and one 3-replicate unit (5 x 2 + 1 x 3 = 13) ^ 

• V 

Before^' implementing sample selection, frame units were, ordered within 
each of the major strata in serpentine fash^ertf by state and altematingly 

within states /by increasing and theaT^ecreasing value of percent racial 

. . . ^ ^ f ^ 

minorities. > * ^ * 

From the described stratrf:yc^, ordered sampling frame, five ^qual siz* 
samples were selected utilizing a probability mirfimum replacement (PMR) 
algorithis, '|irhich allows exact ^probability proportional to size selection 
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Table 2-4. 


Sample allocation by region 
• 


and SDOC categories 

9 




Region 


SDOC 


Size 
measure 


Single-sample 
allocation 


Integer single Five-sample 
sample allocation allocation' 


i 

1 

1 


1 


1 
2 
3 
4 

5 * 

1 
2 

' 3" ■ 
4 
5 


231,294 
321,465 
127,115 
20,769 
1,038,162 

171,171 • 

90,dVj — . 
272,331 
312,766 
127.759 
974,038 


12.67 
8.68 

12.07 
4.77 
0.78 

38.97 

6.42 

^ 3.38 
10.22 
11.74 
4.80 
36.56 


13 
9 

12 
5 
1 

40 

6 
3 

10 
12 
5 
36 


• 65 
45 

60 ' 

.25 

5 - 
200 

30 
15 

50 , 
60 

-25 ^ 
180 




3 


- 1 
2 
3 
4 
5 


482,934 
186,151 
268,679 
188,897 
211.410 
1,238,071 


14.37 
6.99 

10.08 
7 .09 
7.94 

46.47 


•-^14 . 

7 
10 
• 7 

8 
46 


70 

35 . 
50 
35 
40 
230 




. 4 


' 1 
2 
3 

. 4 
' 5 


496,084 
78,696 
* 268,835 
138,779 
• 83,343 
. 1,065,737 


18.62 
.2.95 

10.09 
5.21 
3.13 

40.00 


19 
3 

10 
5 
3 

40 


95 
*15 

50 
25 

2P0 


i ^ 


TOTAL 




4,315,0081^ 


162.00 


\61 ! 


810 


■ 1 
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1 

1 
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Table 2-5. .Allocation in terras of 2-, and 3-replicate units 



Siqigle-sample alIoc^tion Five-sample allocation 

Region> SDOC Total reps 1-rep 2-rep . 3-rep Total reps 1-rep- 2-rep 3-ri 



1 • 


1 








5 


1 

X 










J 






0 






3 f 


1 

X 










c 




3 


12 






6 






60 • 










6 








2 






&w 


c 


10 






7 


1 


1 






- 




5 


5 , 






\ • 




40 


2 


16 • 


2 




200 


10 


"«0 






1 








3 






30 




IS 






2 


3 


1 




1 






15 










^ 3 


•10 






[5 






50 




25 






/ 4 


12 






6 






60 




30 








5. 


1 




2 ' 


- 




25 


5 


10 


- 






36- 


2 




7 ■ 






180 


10 


85 




3 


1 


14 






7" 






70 




35 


• 




2 


7 


i 




2 


1 




35 




10 


5 




3 


10 






5 






50 




25 






4 


7 


1 




3 






35 ' • 


5 


15 






5 


8 V 






4 






40 




20 








• 46, 


^ T . 


21 


T 




230 


~5 


105 


5 


4 


1 


19 






8 






95 




40 


. 5 




2' 


• 3 


1 




1 






15 


5 


5 






3 


10 . 






5 ' 






50 




25 






4 


5 


1 




2 






25 


5 


•10 






5 


3 


1 




1 






15 


5 . 


5 








40 


3 


17 


T 




20P 


15 


85 


"5 


TOTAL 




162 


8 


71 


4 




810 


40 


• 355 


20 



1 * 
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of a fixed number Of units from a frame ^^ith units of unequal size. Four 
of the samples were randomly assigned to the assessment years 1 1 through 
14. The primary- sample utilized for Year 11 of National Assessment is 
listed in Appendix F, The fifth sample was reserved to, serve as a soyrce 
of replacements for refusing primary units and a possible supplemental 
sample under a large sample option*. 

The procedure used for selecting the .five equal sized primary -samples 
did not preclude the possibility that some ^i"ame units might be selected 
more than^once. Further, the method of assignment of multiple selections 
to the five samples" (years) did n1)t ensure balance by year, thus a^ sample 
PSU could be assigned twice to one year and not at all in another. The 
primary sample was ^examined determine how many, times «this situation 

occurred. Three occurrences ^rfe identified across thtf entire five-part 
sample ^nd revisions were to balance the sample by year in these 

instances. Only on! of the adjustments affected the ^Jear 11 primary sample. 
Hone of the PSTJs selected for the special augmentation/ replacement, 
sample* were rej^uired for PSU replacement in Year 11. 
2.3 Secondary Frame Construction and Selection of Sample Schools 
2.3.1 School Frame ^Construction 

For all Yeir 11 primary sampling units, all public and private^ schools 

were enumerated. The grade range, total enrollment, and certain identify- 

ing data were obtained for each school. A computer ta^e containing \he 

desired data was obtained* from Curriqului^ Information Center (CIC)^ CIC is 

a Denver-ba^ed organization that gathers infarroation pertaining .to public 

/ 

and private schools in the United States., Using the grade range .and total 
enu)ll»est data, an estimate of the number of age class elig^bles in eacL 
school was made • ' ^ 



2^,3-l*l Validatiog'of Completeness of School Frame , * 
As noted in tbe preceding section » ail estipiate of the number of age 
class eligibles for each school was obtained using the grade range and 
Xotal enrollfflent data. An estimate of the njunber of age class eligibles in 
each PSD was obtaiaed by summing these estimates across schools. The 
estimate of tfte IT-year-olds obtained by^ this method was compared with an 
estimate of the 17-year-old population used at the primary level of sample 
selection. If the two estimates of eligible 17-yea.r-olds differed consider- 
ably and/or the relations among the three age class totals were determined 
atypical, the following further checks were made. Estimates of age class 
eligibles and primary sampling frame totals for PSUs selected from the same 
State in the previous year'& assessment were examined to see if similar 
discrepancies occurred. If necessary, it was verified that estimates 
appeared for each eligible school in each PSU and that correct data and 
methods were utiliaed in estimating the age cXaSs elig;Lbles for each school. 
2.3.1.2 Validation of Completeness of School Frame for Oversampled 
Populations 

If a primary unit contained a population to be overSamplled, estimates 

were computed of: (a) the total age class eligibles in the oversampled 
^ — ^ 

population and (b) . the percent of age class eligibles in the oversampled 
population. 

If the primary unft contained schools classified as low metropolitan 
and the estimate(^ percent of age class eligibles in the$e schools was 
judged too large or too small , the classification of these schools was 
reexamined. Schools were reclassified from low metropolitan to nonlow 
Mtropolitan status in accordance with prescribed directives. These 
reclassification procedures are detailed elsewhere [9]. 



for each county in the PglL' - ^ • 

2.3.2 Selection of Sample Schoals 

To achieve simple, unbiased variance es^mati^n^^^he^ school frame in 



If the primary^ unit contained an extreme rural popula^ian, it was 

. . ^ ' ^ F ^ 

verified that; the estimated percent rural pojjiulation was pxjlperly* recorded 

e es^mati#n^^the^ 

s^l^""Presenting ^PSUs yas stra'tified into two- an*^three-r^licate areas 
containing populations o^ similar types. -Jor Q,¥aiDple, in a particular 
self-reptesenting unit, one two-replicate . area ^ghtr consist of low metro- 
politan and remainder of the city schools; th^^' second «area containing only 
schools from outside the city limits could** /^count* for another , two repli- 
cates. To simplify estimation of the withi-^ PSlf* variance, contfitution froif 
self-representing SMSAs, schools were fleeted to provide ' two -or three 
nonoverlapping one-replioate subsample?!' which woafd. easily accommodate the 

paired selection .variance scheme. S/^ools in selected* PSHs were chosen to 

/ 

accommodate the number of packages ,^ecified in taT)Ae*2-6. Table 2-6 lists 

k * . 

the anticipated maximum number o^^' packages to be ^administered . in Years 11 

through 14. For those primary ^its selected for 2/pr 3 years, the schools 

necessary for the total maximyin allocation for o4e year. were determined and 

doubled or tripled as reqi^ired. l^e plumbers, . of " selected schools were. 

quadrupled to accommodate ; the four year period- , Sip^c^Jtlie number df j>ack- 

ages' specified for Year |1 assessment was not the 6aroe as ta6le 2-6, it %«s 

necessary to subsampleAhe Year 11 schools to conform to the Tear 11 package 

configuration. / - '4fo. *^ ^ . 

2*3*2. 1 Oversjfapling Lo<y Metropolitan and. Extreme T^jjtral Sc)l ools 

School s%r^td were' defined in teAis of 1970 C*ensus data tcri^tyer sample 

the low metropo/itan type of community. Low metropolitan scho\l^ were 
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Table 2*6 « Anticipated maximum number of packages to be 
♦ adm'inistered in iTears 11 through 14 



Age 


t'i- 


Number of 
< group packages 


— ■ 

Number of 
iadividual packages 


9-year-old8 




13 


1 


13-year-old8 




15 


0 • , 


17-year-olds 




> 18 

• 


0 




* 







/ 




N ' ' ^ 

( 

. - ^ ■ ■ ■ . \ 
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t^ose schools located in the Census Employment Survey (CES) low income 
areas.' CES low income areas were defined in section 2.1. Lotrlaetropolitan 
schools were oversampled at a rate of approximabely two-to-ojie in relation 
to nonextreme schools. _^ ^ 

Extreme rural schools were defined as schools located in nonSMSA 
counties where the extreme rural indices computed from .occupational statis- 
tics were abo^e specified values. Oversampliag of extreme rural schools 
was accdmplishecl at the primary sa^^H^ stage. 

* 2.3.2.2 Stratification^nd Selection of Sample Schools 

■ — 

Within each oversample^ and nonoversampled 'stratum, vhools %were 
further stratified by ^^timated number of eligibles. Within each -size 
stratum, schools yith a small number of age cl^ss eligibles were clustered 
in groups of two or three schools until the cluster of schools could collec- ^ 
X-ively- take the number of packages assigned to larger schools in the stratum. 
The schools were clustered such that the total number of age cl^ss eligibles 
in each cluster /was approximately equal. The probability with which each 
school in the cluster was selected was < 

. k 

( , n .Z S. 

P(SchoollPSU) = ' — — i , 

5 / 

where » 

n = total number of schools to be selected from the stratum; 
k s total 'number of schools in the cluster; > 
= number of ag^ class eligibles in school-i; 
' ^ S = total number of age class eligibles in the stratum. 

Schools or school clusters were selected without replacement using 
Sampford's probability proportional to size and without^ replacement sampling 
technique. - 
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2.4 Package Assignment and Field Operations 

2.4.1 , Package ^Assignment ^ 
2.4.1.1 Introduction 

The National Assessment of Educational Progress (NAEP) in-school 
sample was selected in several sta'gea. The selection procedures for first- 
stage sampling units (counties or multi-county areas) and for second-stage 
samplfng"" units (schools) were documented in sections 2.2 and 2.3. The 
selection procedures for third-stage sampliaf- units are documented in this 
section. Since a probability sample of students is required for each NAEP 
f package, the sampling process involved three steps within each school: 

(1) Selection of a probability student saa^e; 

(2) Partitioning of the student sam^e into subsamples; 

<3) RandoB assignment of NAEP packages to the student subsamples. 

In Year 11, the total assignment across all age classes consisted of 
40 unique group packages. This compares to total assignments of 35 group 
^ packages, in Year 09 and 41 group packages in Year 10. All Year U packages 

contained some combination of Reading and Literature- exercises. There also 
were seven Art exercises in one Year 11 Age Class 2 package. At each age 
class, £hree Year 11 packages were made up of exercises recycled from Years 
02 and 06; all other Year 11 packages were made up of exercises which had 
not been administered in previous years. Table 2.-7 shows the distribution 
' . - of Year 11 packages by composition (either new or irecycled exercises) and 

by age class. 

Student selection and package assignment procedures require a current 
^ • updating of student enrollment, grade 'range, and related information for 

•11 sample schools. Thi» requisite information is obtained by the District 

ERIC . o • 
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Table 2-7. Number of Year 11 packages by age class 
and composition 




Number of Packages 





All Recycled 


All New 


Total 


Age Class 


Exercises 


Exercises 


Packages 


' 1 


3 


8 


11 ^ . 


2 


3 




15 


3 


3 


11 


14 


Tot?l 


9 


31 


40 



5 



33 



Supervisors (DSs) during introductory meetings with superintendents, princi- 
pal*, and/or "their representatives. During these introductory meetings, 
new schools in selected districts and sample . schools with gra^e range 
changes are reported to the District Supervisor. . This information is 
relayed to the Research Triangle Institute (RTI) Sampling Research and 
Design Center (SRDC). Using probability procedures, new schools are 
admitted t^ the sample and sample schools with grade range changes are 
readmitted to the -sample. 

Student selection and package assignment instructions are then 
prepared on a flow basis and coordinated with the field operation. Table 
2-8 ^hows excexpts from the Year 11 schedule for in-sxhool administration 
and sampling. In order to elimiA^te some of the assessment burden on 
17-ycar-old schools, the 17-year-oljj/student samples were selected in a PSU 
at the same time that 9-year-oM assessment was conducted. This procedure 
allowed 17-year-old schools more time to prepare for assessment. As a 
result of this change, it^ was necessary tol^ procfess 9--^<i 17-year-old 
package assignments simultaneously in December and -January as noted in 
tabic 2-8. Included j^p the Age Class 3 package assignments were additional 
instructions to supplement the student sample with students who might have 
entered school since the Age Class 3 student sample was selected. 

A new procedure of checking in packages using District Supervisor 
4 

identification numbers rather than PSU based package identification numbers 
was initiated in Year *09 and continued in Years* 10 and 11. This procedure 
is explained ia section 2. A, 1.2. Procedures to update the school sample 
are documented in section 2.4.1.3. Section 2.4.1.4 docmnents the method by 
which the number of eligible students in each school is estimated and how 
the Principal's Questionnaire data are used to restratify each school by 

40 • ' • 



type of community (TOC). .The actual allocation and assignment of packages 
5^0^ schools is documented* in section 2.4. l.S. ^ 

To initiate thfe package assignment procedure for a given PSU, certain 
data pretaining to that PSU must be collected and traasmitted to the RTI 
sairoling staff. Thtese data ar^ collecfted on'specific forms, which Include 
the PSD Control Sh^et and the Principal's Questionnaire. ^i^pifes of thesJi^ 
forms are ^eluded ^^s appeftdixes ^ and A, respectively. Additionally a^ 




completed' set of computer prepared package assignment forms' is included as 

appendix E. . ' 

♦ 

^2.4.1.2 Package Identification Numbers 
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, Within each nrimary sampling unit (PSU), each group package was adrain- 
istered one,, two or three times; therefore, either one, two or three harcf- 
shells containinjg 18 to 24. copies of each group package were distributed in 
each/' PSU. Unique ranges of package identification numbers were assigned to 
package copies within each hardshell. The package identification numbers 
^ were used to linjc the respondent to the package administered within each 
school; however, the particular packages, to which an individ^ial Responded 
can be detected only from records wl^ich never leave tjie school. 

In Year 11, each District Supervisor was assigned a package identifi- 
, ' « cation nibber ranfe^ased on the number of package administrations in 
primary sampling units- under his supervision. Table .2-9 lists the Year 11 
District Supervisor package identification ranges by age class. Pre- 
^ assigning the ranges enabled Westinghbuse DataScor^ Systems to pWjrint the 
package identification numbers. Previous t^ Year 09, District Supery^ors 
had roanuallj^ coded the package identification numbers on each package. The 
new procedure provided more time for ttoe District Supervisors to perform 
oth^r tasks such as monitor sessions, teview exercise administrators* work, 
etc. ^ . • 

- - '41 , • 



■29- 



• Package identification . numbers were utique within a school and linked 
resp^ondents to packages within a school. Again, the forms linking the 
respondents to the particular package .administration. never left the school. 
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Table 2-8. 



Schedule for Year 11 package assignment 
and related field activities 



Period 



Activity 



August 27 - October 5, .1979 

September 17 - November 9, 1979 

October 8 - December 14, 1979 
November 26 - December 28, 1979 

January 7 - February 29, 1980 



March 3 - May 2, 1980 



Ag6 Class 1' and 2 introductory 
meetings . 

Package assignment for Age Clas 
2 schools provided. 

Age class 2 assessment. 

Package assignments for Age Cla 
1 and 3 schools provided. 

(a) Age Class 1 assessment. 

(b) Select Age Class 3 sample. 

Age Class 3 assessment. 



■0 




0 



Table 2-9*. Year 11 District Supervisor package 
identification ranges 
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2.4.1.3 School Sample Adjustments 

2.4.1.3.1 Updating ^Sample for New Information 



In Year 11, sample schools were selected on the basi's of the most 
jcent information available. However, when selected districts and schools 
were contacted by thc^District Supervisor, new schools may have been found. 
In addition, sample schools were sometimes ^ound to have closed or to have 
\ changed grade ranges such that the schools no longer contained eligibles 
for the particular age classes for which they were selected. These changes 
•were reported to the RTI*sampling staff and the file ott schools was updated 
to reflect the current information. 

New schools which were reported to the RTI sampling staff were admitted 
to the Year 11 sample on a probability basis. The sampling procedures, by 
^hich this task was accomplished are documented elsewhere [4]. 

Procedures were also followed to properly handle schools that became 
eligible 'for a new target age group sample due to grade range change. 

In Year 11 an additional" «»three schools were selected into the sample 
as a result of these updating procedures. Table 2-10 lists the number of 
new schools that were added to the sampling frame and the number of these 
schools whichr were 'selected. The same information is also given for sample 
schools with grade range changes. ^ 
2.4.1.3.2 Sample Adjustments for School ^Nonparticipation 
2.4.1.3.^2.1 Reasons for Nonparticipation 

Nonparticipating schools may be . classified into these three main 
categories: * 

(1) Closed scho|l8; 

(2) Schools lacking age class eligibl^; ^ 

(3) Refusali. 



Table 2rl0. Tear 11 new schools and sample schools with grade range 
changes admitted to the sample on a probability basis 



• 


New Schools 


Schools with grade 


range change 


Region ^ 


. Added to 
sampling fraM 


Selected 


Added to 
- sampling fraae 


Selected 


Northeast 


3 


1 


4 


0 


Southeast 


10 


4 

1 


2 


^ 0 


Central 


4 


1 


2 


0 


Vest 


15 


0 


2 


0 


Total: 


32 




) 10 


0 


it 

A school was 
f raac , 


coiinted for every 


age class for 


which it was added to 


the sampling 



4 




-34- 

( 

/ 

Table 2-11 sUl^parizes schpol nonparticipation in Year 11 of National 

Assessment by age^cljass. Approximately. 13 percent of the selected schools 

- t . . 

did not participate in assessment. Percentages in each nonparticipation 

category are also shown in table 2-11 for the overall sample. 

2.4.1.3.2.2 Selection of A^itional Schools as a Result of Original 
Sample School Refusals 

In Tears 01 through^06, approximately 1,000 schools were $elected per 
age class. In an effort to keep travel costs tp a minimum, the Year*? 
through 11 schooj. samples were designed so that approxiiaately 500 schoorls 
were selected per age class. As a result,, the Year' 07 through 11 schools 
were assigned more packages* per school than in previous year^. Since the 
number of Year 11 sample schools was considerably reduced, school refusals 



• were especially critical. In many^Ases, the refusal of a school resulted 
in not enough schools remaining in the PSU to take the allocated packages 
and maintain group sample siz^s of 16. As schools refused, the remarining 
school^ ^in the PSU were examined. If not enough schools remained to main-r 
taiti groiq> sample sizes of 16, then replacement schools were selected. A 

^ total of 51 replacement schools. were selected. These schools are listed by 

/ 

age class and region in table 2-12. 

2.4.1.4 Use of the Pri,ncipal*s Questionnaire Data 

Data from the Principal's Questionnaire for selected and participating 
school were M%pif far a number of different purposes. Some of these 
purposes included estimation of the number of age class elig^les in ^each 
school; determination of the^^Jvdmher of split or modulat sessions for each 
school; and estimation of the type of community (TOC), derived size ^of 
community (POC), and srze and type of community (STOC) indices for each 
sample school. A detailed explanation ^s to how the Principal's 
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Table zjlZ- S'SwraMry of Year fl simple school noni^artlcipation 



Age> Age Age Total Samp le 

Class 1 Class 2 Class ^ "n^: Percent 



Total Schools S^Z^^^^^ . 608 

Aase^saent. r^onitiucted . 56d 

» 

AsAessaeoC J^»- Conducted 48 

Refusesc 32 

Closed • 6 

^o Eli-gibUes 

Ear=.::J.ec:i 10 

Other^ 0 



642 


490 


1,740 


190.0 


534 


412 


1,506 


86.6 


108 


78 


234 


13.4 


41 


46 


119 


6.8 


10 ■ 


■ 2 


18 


1.0 


54 


28 


92 . 


5.3 


3 


2 


5 


0.3 











i^Includes new.scioo-ls selected via sample updating and repAcenent schools. 

^, - — ■ - - V . - - — - 

-'Schools .found Ive outside the selected PSU and dropped from the sample 
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.Table 2-:J2. .Numbers of Year 11 replacement schools 



tiOTi 



^ ._ 

jHortheast 
/ Southeast 
/ Central 
' / "west 
j- Total 



Age Cniass 1 



: 1 
-, 1. 

0 

11-3 
135 



Age Class 2 



6 
4 

3 # 

17 



Age Class 3 Totel 



2 
2 

i 

19 



13 

7 
5 
26 
51 
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Questionnaire was used fol^ each of the preceding purposes is provided in 
section 2.6 and elsewhere [4]. * . 

2.4.1.4.1 Estimation of Number of k^e Class Eli ffibles in each School 
In Years 01 tjxrough 09 the grade-by-grade enrollment on the Principal's 
Questibnnaire' along with 1970 Cefisus estimates of proportions of age class 
eligibles by state were used to estimate the age class eligibles in each 
school. In Years -07 through 09, |he' targeted per package sample sizes of 
2600 were slightly und'e Lhieved.t It was felt that this underachievement 
was in part due ' to an!' overestiiatioQ of age class eligibles I'n sample 
schools. Part of the overestima{ion may have been caused by using 1970 
Census estimates to Estimate 1978 an-3 1979 populations. Unfortunately the 
Census Bureau does- not "upiJate these' estimates between censuses. 

In Year 10, because of this underestimation, a decision was made to 
change the method of estimating age class eligibles per school, and the new 
procedure was also followed in Year 11. Year 09 response data and 
Principal's Q^iestionnair* data were used to develop regression equations to 
^ predict , estimated eligiiles in Year 11 bf school separately for each age 
class; Independj:nt variables included region, size of community, percent 
Black, and percent Hispanic. The dependent variable was proportion respon- 
dents" by gradtf^. A separate predicti^ equation ,was developed for the 
■ proportion respondents in each' grade associated with the age class (i.e., 
g'rades 6 through 9 for 13-year-olds). The prediction equations were then 
combined to produce the total estimate of age class eligibles. The regres- 
sion eqiation* fo;>^each age class are listed in table 2-13. 

2.4.1.4.2 Computing the Number of Students Ava ilable for Assessment 

in Each School * r 

In rtrtai| large schools, t^e District Supervisor is allowed to 
. '^coaplete Student Listing Forn.. (SLFs)- for a si*sample of the eligible 
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students rather than ill. SLFs are. forms on which all eligible stucJents 
for a particular sampld^ school are listed. Whether subsampling of the 
student list in the sample school is allowed is noted on the PSU Control 
Sheet by a digit other than one (1) appearing in column 9 of the form. The 
number appearing in column 9 is the count interval te be used in the sub- 
sampling process. Column 8 lists the start number for |he subsampling 

r 

process. The pjrocedure by which the entries in column 8 and 9 are computed 
are documented elsewhere [4] - 

2.4.1.4.3 Restratifying Sample Schools Based on the TOC Index . 
Within each PSU^ sample schools were ranked on the basis of their TOC 
index from most extreme to least exjreme type of community. The TOC index 
for each school is computed from data supplied on the Principal's 
Questionnaire. . The procedure to compute the TOC index is documen)ted in 
section 2.6.2. The derived size of community (DOC) was input to the pacjcage 
assignment computer software. The DOC^index is a means of classifying 
schools as to size of place apd loc^i^on with respect to urbanized areas of 
large ^cities. Using the DOC index and the TOC indexT^chools were ranked 
from most extreme to least extreme tjrpe of community. 

for each schodl, the expanded enrollment was computed as the estimated 
number of age class eligibles divided by the selection probabi^ty for the* 
school given the PSU. The expanded enrollment was summed over all schools 
to obtain a quantity called the total expanded school enrollment for the 
PSU. In addition, two quantities which were computed at the time the 
secondary sample was sele#^d^were utilized in the restratif ication process. 
These quantities wer6: 

A = the fraction of the age class eligibles looted in the 



oversampled region of the PSU; 

Si 



^ Tabl^ 2-13. Prediction equations to dete-nnine number of 
age .clas» eligibles in sample schools 



^9i = ^2, 91^2.91 * •2°"E3,9iH3^g.R3 g.S^ g. 

t •^997E^ g.H, g.R, ggS^ g.B^ g. 

+ «.S, 



« 



5,9i. 5,9i 



^13i " ^6,13i^6,13i * -^^^^^7,131^7,131^7,131^,131 

* .6206E3^j3.Rg^j3.Sg^ ^3.83^^3. 

* ^9,131^9,131 c > ^ ' 
^1/1 ^ ^9,171^9,171 * •^^^^10,171^10,171^10,171^10,171 

■*■ , ^11,171^11,171 • 

* .0827Ej2,171^2,l7lSl2,178 ' 



where 



Tj^ = estimated j-year-olds in school-i; 

Ej^.^ = grade-k enrollment from Principal's Questionnaire for 
estimated j-year-olds in school-i; 

H^.. = grade-k regression coefficient associated with Principal's 
Questionnaire percent Hispanic indicator variables for 
estimating j-year-olds in school-i; 

Percent Hispanic H 



indicator variable 



3,9i - 4,9i 



1, if school-i percent 

Hispanic on PQ < 25%; 1.2597 1.0786 

0, otherwise. 

, 1, if school-i percent 

Hispanic on PQ > 25%; 1.0000 1.0000 

0, otherwise. 









- 
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Table 2-13. . 


Prediction e 
age class e'] 


iquatioas to 
.igibles in 
:oatiaued) 


determi 
sample s 


K number < 
choo!Ls 


Df 








R = grade-k regression coeffrcient associated with region 

indicatpr variable for estimating j-year-olds in school-i; 








ReRion 


3,9i 


a, 91 


^7 13i 


^8,13i 


^10,17i 


^12,17i 




iadicator variable 
4 










1, 


if school-i in 
Northeast Region; 


0.6588 


1 . 1309 


U • oo / 0 




0.7766 


1.5433 




0, 


. otherwise. 
















1, 


if school-i in 
Southeast Region; 


0.8174 


1.0639 


6.7627 


1.1069 


0.6114 


1.1116 


• 


0, 


otherwise. 














• 


' 1, 


if school-i in 
Central Region; 


1.0471 


0.9791 


1.0430 


1.1013 


0.687'6 


0.6760 




0, 


otherwise. 
























« 


..i,flDno. 


. .1..0000 


1.0000 




. .. . 


if school-i in 
West Region; 


~ i:-oooo 

• 




0, 


otherwise. 


















S = grade-k regression coefficient associated with size of 

. community (SOC) indicator variable for estimating j-year- 
in school-i; ^ 


olds 






. SOC 


^2,9i 


^3,9i 


^4,9i 




^6,13i 


^ ^7,13i 


• 


indicator variable 








1, 


if school-i in 


O.OllO 


' 0.8005 


1.116 


0^.0137 


0.0227 


0.784( 




0, 


otherwise. 


. ,\ 














1, 


if school-i in 
SOC 2; 


0.0059 


0.7669 


1.1077 


0.0059 


0.0300' 


0.948: 


1 


0, 


otherwise. 




« 


* 








1 
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Table 2-13. Prediction equations *JLo determine fiumber of 
age class eligibles in sajsple schools 
(continued) 



SOC 

indicator variable 

1, if school-i in 
SOC 3; 



^^,9^ S.9i ^4,9i ^6J3i ^7,131 

0.0071* 1.0088 1.0514 0.0050 0.0193 1.0512 



] 



0, otherwise. 

1 , if school-i in 
SOC 4; 

0, otherw^fe. 

1, if school-i in 
SOC 5; 



0.0070 1.1729 0.9954 0.0028 0.0210 1.2352 



) 



0.0162 1.0000 1.0000 0.0043 0.0291 ' 1.0000 



0, otherwise. 



SOC 

indicator variable 



^8,13i ^9.13i ^9.17i ?10,17"i ^12.17i 



if school-i in 
SOC 1; 



0.9949, 0.0136 0.0246 0.7062 - 1.3561 



0, otherwise. 

1, if school-i in 
SOC 2; 



1.11^ 0.0080 0.0171 0.6848. 1.0137 



0, otherwise. 

1, if school-i in 
SOC 3; 



0.9901 0.0042 0.0072 0.9373 0.8831 



0, otherwise. 

1, if school-i in 
SOC 4; 



0.9704 0.0059 0.0109 0.2324 0.8395 



ERIC 



Oy otherwise. 

1, if school-i in 
SOC S; 

0, otherwise* 



1.0000 * 0.0010 0.0220 1.0000 1.0000 
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Tabl^-13. Prediction Equations to detennine number of 
^ age cDms eligibles in sample schoo^* 



(continued) 



4 



\yi " grade-k regression coefficient associated with Principal's 

Questionnaire percent Black indicator variable f6r estimatine 



j^year-olds in school-i; 



^* Percent^Bla^ ' ^ B ' . ' B ' B B * p 

indicator ifariablg ' 7,13i ^ 8,13i , 10,17i . ^U,17i 

^ * ' ' • . • 

1, If schooW % Black i:i443 0.7963 1.1074 0. 754^ ^tJ. 6960 • 
< ^ on-PQ IS O-to 24%; / ^ ^ ]j 

0, otherwise. * * / \ 

if school* i-X Black 1.0729 0.9382 0.8883 1.1933 0 5574 
^ PQ is 25 to 49%; > u.dda^ 

0, otherwise. • . ^ 

if schaol-l % Bl^ck 0.8860 1.2928 0.7949 1.7700 ^ 0.5631 
on &t IS 50 tp 7\X; ' ' ' / 



1 



V 

otherwise. 



1,, if Jchool-i X Black 1.1)000 ^ l.OQOO 1.0000 1.0000 0 5833 
.01^^ is 75 to 100%; ^ " ' ^.^ooo 



0, otherwise. 



9 
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. \e fraction of the age class eligibles located in the 
npnoversampled region of the^U; 

9 

= . 1 - A. • • ; 

An oversan^led poststratUB. was fonned by sunning the exp^ded enrollment 

for each school down the list of racked schools, until this su»\xceeded 

A, ti.es the total expanded school enrollment for the PSU. The oversa^led 

p^stratun. then consisted of all schools included in this sum. The 

alining schools were placed in the nonoversa^led poststratua. A fraction 

of the 'total number of group packages for the replicate and the age class 

was then allocated to the oversan^led, poststratum. .This fraction was 

where A and B were defined earlier. The remainder of the packages 
2A + B - ^ « 

were allocated to the nonoversalnpled poststratum. 

• It^shoGld be no'ted that when A. fraction of the age class eligibles 
'located ^in the oversampled region^of t^^ PSU. equals one (1.0000). then B 
equals z^ero (0.0000). and alf schools are placed in the oversampled post- 
stratum. ~ Furthermore, all packages a\e allocated to the oversampled post- 
stratum. When A equals zero (0.0000). then B equals one (I.POOO) and all 
^ schools are placed in the nonover samp led po|tstratU«. All packages for the 
replicate and the age class. are then allocated to the nonoversample^ poat- 

stratuja. ^ • « 

2.4.1.5 Package Allocation 

•2 v4 • 1 ^1 Standby Schools ^ 

schools havink fewer than the designated number of eligible respon- 
. dents for the administration of a group package were specified as standby 
' schdol.. Each ^tandby school, recei^i at most one group administered 

package fro, tht planned number of group 'administered packages for the PSU. 

Many .tandCy school, received only some portions of a group ad.^istered 



Ob 
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package. The' deterinination as to whether a standby schSbl was to receive ^ 
16 copies of the package to be ad-inistered or a ^^action of this number ^ 
„.. cade to be consistent with the weights for other packages in the PSU. 

All standby schools froo. each PSU w^e placed togefher .as a separate 
part of the nonoversa^pled poststratun. (or oversan^led poststratun. if a 
nonoversan^led poststratun was not defined ^or the PSU). Oversan^led and 
' ^noversa^led' poststrata have been previously defined in section 2.4.1.4.2. 
The standby sci^ools ,s a group were allocated packages fro» the total , 
packages allotted to the nonoversaarpled poststratum in proportion to the 
aggregate expanded enrollment for all standby schools. The pacLge allo- 
,n for the standby schools as a group was then apportioned ^ong the 
ind^idual standby schools in proportion to their expanded enrollment. 
When it was pecessary to apportion the. 16 copies of the package among 
several standby schools, each school's proportionate share .of the copies 
va^ computed in tenn8-=of expanded enrollment. 

2. A. 1.5. 2 rh> .rkinirthe Fe a sibility of the Tentative Package 
Allocation 

For nonstandby schools within each poststratum. 'the tentative package 
allocation was compared with the maximum number of packages which that 
school ' could absorb. When a package allocation for a given school^ was 
dete^ined to reqnirt more eligibles than were present in th* school, the 
package allocation for the school was reduced to the maximum that school 
C6uld take, and the remaining package, were proportionately allocated among ^ 

1. 1 TV^^ T^rnr#.dure bv which these remaining packages 
the remaining schools. The proceaure oy wuxcu 

were allocated is drtailed elsewhere [4] . * ' 

2.4:1.5.3 ...^f>n4nf > Packaees to Schools , ofe the. package allocation 
„a. determined for each school in the .PSU, the actual package numbers were 

' ■, ' 

•• • • 57 



« 
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*- ^ nncP and then repeated in a two- 

« school. The randim permutation was used once 

r' ■ ' . twice in a three-replicate 

.eplict. PSU, it .as used one. and rep.at.d tw.c. 

f PSU. ' • . ^ • , 

1 • ■ , a. pac.as. assU.«.o, eac. sc.oo. in a PSU was p....d 

n ■ ^ ^. co^ut... A pa.U.. assi.n..nt s^.. fo^ -as also printed. 

U , „ and the pacliage assignment 

sample of the school package assignment .form and the p 

i summary form are included in appendix E.^ 

■ . \ 2.4.1.5.4- ctnH.nt Selection Procedures. 

- I ' • ■ • ..Hnre was used to select sample students. 

- ' A simple random sampling procedure was use . 

oL" hv 11'*^ form listing up to 25 
' ■ ' -The Student «Listin» Form (SLF) was an SH. by 11 . f , 

fo™ The listed students were numbered consecutively and 
btudents per form. The iisceu , ^ 

\ i.cted using a random number table provided on^the 

I sample students . were selected using a r . ^ 

..The student selection procedure 
■ ; \ package assignment form (see appendix E). The 

documented elsewhere l5l t6] . ' 

. «ize oer school varied from 16 to 

In Year 11, the group session sample size per 
. -T,. sample Size was varied in order to control sample Size by type .f 

I '^unity Ci.e.. different .yp.s of co»ounities 'yield different^ response 

were also varied for . the related purpose of 
rates). Gioup session sizes were aiso i 

• c.n^ratelv withih the overs^mpled and non1>^- 

equalizing student weights separately witn ^ 

sampled strata. .... 
' ■ for each school was computed. Lei Z be an 

The group sample size for eacn 

I ' 1 /-^n The Rroup package sample size for 

r , estimate of the target population. The gro p y 

• ^1 ] ; 8chool-i was then computed as I 

ERIC > ; ' 
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f G R. . • 

^ (2.1) 



where 



i P. g.M 



2 592 

£ = ^T-^^^ for nonoversamplcd substratum; 
Z 

c 1 0A 

= ^> *° for overs^fjpled substratum; 

f 

G =* the number of group administratiotis for one replicate 
(i.e., for 9-year-olds, G = 11; for 13-year-olds, 
G = 15; and for 1^-year-olds , G = 14; 



1 



the. number of age class eligibles for school-i; 



P. = P(PSU) X P(School-i 1 PSU); 



1 



g = " the number of group administrations assigned to 
school-i; ^ 

M = response rate by SOC as computed from table 2-14. 

In Year 11, the group sizes in equation 2.1 were updated prior to 

student selection when the true age class earollments, say N^, had been 

ascertained. Knowing the Principal's Questionnaire enrollment estimates 

R^, the package sample Uize as computed from equation 2.1 permitted the 

updated ^timate to be made as 

with rouB(3ing to the nearest integer. Upper and lower bounds for the n^ 
were set to avoid adding additional grpup administrations on one end and 
failing shbrt of the targeted- size^ on the other. The upper and lower 
bounds were set at 25 and 16, respectively. A tabl^ was provided on the 
package assignment form which gave tle^djUsted group, session size associ- 
ated with specified ranges of H^. (See appendix E.) . . 

, As noted earlier, an additional package assignment form was* prepared 
for 17-year-old assessment (see appendix E) . This forrt allowed studehts 
who had entered school after the 17-year-old sample had been selected and 
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Table 2.14. Expected student response rate by siae of community (SOC) 



SOC 


9-year-olds 


13-year-olds 


17-year-olds 


1 


.8239 


.8127 


.6255 


2 


.8687 


.8354 


.6094 


3 


.8878 


.8404' 


.7007 


4 ' 


.9019 


.8820 


.7406 


5 


.8884 


.8756 


.7713 



( 
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before assessment had been conducted a chance to enter the sample. The 
17-year-old student samples were selected during the 9-year-old assessment 
to allow 17-year-old schools .more time to prepare for assessment. The 
additional studei^ts were sampled at the same rate the original samples were 
selected. h table prepared for ttfe package^'assignment form applying 
this sampling xatt to additional numbers of eligibles up to 30. Additional 
tables of random lumbers were supplied on the form. Once the number of 
additional eligibles to be selected was determined from the table, the 
, eligibles were selected by numbering the list of additional eligibles and 
applying the supplementary table of random numbers. The package • order ing 
which appeared on the ortgiaal package assignmeiSt form was reversed on the 
supplementary form and useii £o assign thi^^^ditional selected eligibles to 
packages. Packages are usually'^aTliiriai^eE^^ ^llowing the administration 
order. Reversing this order aUowed the scho<^ more time to contact addi- 
*. tional students selected through the updating ptocess. ' 

2. -A. 1.5.5 Assessment Completion Rates . 

The target sample ffize for each package waK^5?2 respop-rf^nts . The 
actual sample sizes per package in Year 11 are recorded in table 2-21. For 
9-year-olds, the actual sample sizes varied fronf 1 to 5 percent above the 
^ target. pAr 13-year-olds, the^^tual Isample sij:es varied from 5 to 12 
percent abov^ the target. For 17-year-olds, the actual sample sizes varied 
froa 3 percent beloj^he target to 2 percent above. * 

2.4.2 Field Operations 

2.4.2.1 Support of plfeld Operations 

Field support activities are designed to assist the field staff to 
collect quality data. Field support activities for Year 11 were as 
follows*: V 

Er|c ' 



/ 



First, RTI's sampling staff wrote letters, made visits, and/or made 
phone calls to selected school, district, and State officials to -obtain 
their cooperation on an as-needed basis as requests for assistance were 
received from the field operations staff. When anftiguitif^ arose, it was 
also the RTI sampling staff's responsibility to ' determine, by checking 
secondary frame listings, precisely which school buildings were selected 
into the sample. ' 

Second, the RTI sampling staff altered package assignments as required, 

/ 

because of a school refusal or a shortage in number of eligible students/ in 
a given school. Notice of suth changes we^ \transmitted to National 




field staff. The RTI sampling^ and survey operations staffs cooperated to 
resolve discrepancies or missing information on Principal's Questionnaires/ 

( 

br PSU Control Sheets received from the field. Such discrepancies werc> 
resolved by mail or telephone. Copies of Principal's Ques tionniarcs and 
PSU Control Sheets can be found in appendixes A and D, respectively. V 
^ Third, many sample schools, particularly those in Age Class 3, were 
found to contain modular sessions or several separate sessioils. These 

4 

sessions were termed split sessions, and each session was entered on the 
computerized file of schools. 

Fourth, machine readable files were updated throughoJ^ ^hc year to 
reflect changes in school personnel, in school enrollment, in grade range, 
in^*chool participation status, and in district personnel. These updates 
were ge'ticrally made before the .package assignment was dete^iTmined for each 
PSU and each #ge class. 
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Fifth, lists of selected, schools y package identification numbers^ and. 
PSU Control Sheets we,re carefully proofed before delivery to RTI' s NAAC 
staff for distribution in the -field. ' 

Sixth, the editing, codtng, keypunching, and checking of all school 
worksheet data for^ all three age classes were^ a part of the field support 
activities. Productipn of sample completion ^ reports by PSU, region, and 
District Supervisor for each age class was a further field support activity. 
The school worksheet -data were the input da$a for these reports. School 
worksheet, data were also use^ to coaipute the weights for each age cLass. 

Lastly, it was often necessary for the sampling staff^to consult with 
NAEP, DataScore, or RTI*s NAAC staff and to prepare position papers and 
working papers and to participate in Q,ccasional special projects as a 
result of such consultations. These activities, too, were a part of the 
general field support activities. 

2.4.2.2 Quality? Check Activities , 

In Year 11, .a probability Sample of 40." srhools «was selected for a 
quality qheck.^ Schools were selected from all three age classes to contin- 
uously monitor the activities of the field staff. The pu3T)osJ5 of the 
quality check was to ascertain the quality of the Natiolfel Assessment data 
being collected by RTI and ,itfi subcontractor, ^^Westinghouse DataScolre Systems. 

More specifically^ quality check activities Were conducted to' detc^rmine: 

* f 

(1) The accuracy of field staff transfer of student identifying data - 
from the Student Listing Forms (SLFs) to completed packages; 

(2) The extent to which prescribed procedures had been employed in 
administering packages; 

^3) The extent to \^hifh SLFs had been completed for all eligible 
students enrolled In sample schools prior to sample selection. 
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The quality check sample was designed to nfovide: 

(1) At least one school per age class for each District Supervisor; < 

' (2) -A ratio estimate of>^the completeaess of the student sampling 
^frame across all age classes. 

'.An estimate of the variance of the ratio estimate in item 2. 
^ above. 

A final report summarizing Year 11 quality check activities was prepared 
and delivered to National AssessmentSin October 1980 [7]. 

2.5 Weight Computation \P>v_y 

School and package weights adjusted for nonresponse for each age class 
were computed. School weights are appropriate for weighting background 
data collected from all students in a school, -fc^ckage weights along with 
student response data provide ratio estimates of the population members whp 
respond in alternative ways to National Assessment exercises. School and 
package weights were^omputed as the reciprocals of appropriate selection- 
probabiltles. The weights are computed using formulas and nonresponse 
adjustments previously approved by National Assessment staff. 

Following ^he assessment of each age class, a tape containing student 
sample .sizes by package was received from Westinghouse DataScore Systems. 
Student sample siz^s recorded from the School Worksheets were reconciled. 

Tajes containing the sample weight^ for each age class were mailed to 
DataScore where the weights were merge-d with the Response data. Copies of 
the merged dAa tape were sent to National Assessment for analysis purposes 
.'and to RTI for efficiency studies. 

At the same time that the respective weight tape for each age class 
was ma^ed. to DataScore, intermeiliate documentation was mailed to NAZP for 
review. The intermediate documentation included weight sums, weight distri 
butiona, by magnil^ude of weight, and explanations for atypically small and 
large veigbtt. 



: -52- 

Package and school weights are discussed in greater detail in .the 
sections which follow. The formulas used to compute package and school 
weights are reviewed in sections 2,5.1 through 2.5.4. The weight 'computa- 
tion software is documented in section 2.5.5. In section 2.5.6, the resul- 
tant weights are summarized-^^ax^ compared with known population totals for 
ao assessment of the accuracy of the sample. 

2.5.1 Regular Assessment Package Weights and Nonresponse Adjustments . 

Weights for 9-, 13* , and 17-year-olds assessed in the regular in-school 
assessment were compuJted for Year 11 following procedures similar to those 
employed in previous yeaf^.-^ 

^aij * weights for package-a administered, in school-i to s\udent-j , 
is defined as ^the\ inverse of j i the probability that stpdent-j in 
school-i is selected to take package-a, multiplied by appropriate adjust- 
ments for student, sc&ool, and PSU nonresponse. The weights can be 
expressed as 

A, n^ 



W 



ai 



aij P . . • n' 

^ ai 



where , ♦ 



/ 



W^j^j ac the weight: -for package-a adininistered\to 



J , 1^^^^ sj^fadent j of school-i; \ 

P^^jj^ the probability of selecting student-j of 
school-i for pack^ge-a; 

n^. = the -number of students* selected for school-i 
for package-a; 

n^^ * = the number of respondents to package-a from 
school-i; 

A. = the combined adjustment factor for school and 
PSU nonresponse. 
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P is computed in one of two ways depending on whether s-chool-i is a 
standby or nonstandby school. In the following discussion, 

P. i the probability that school-i is in the sample = P(PSU) 
X P(school-ijPSU); 

the planned , student sample size for package-a in school-i; 

R = the number of eligible students in school-i; 
i 

G 5 the number of group packages assigned to school-i; 

i - , ^ 

N = total number of administrations per replicate for Age 

Classes 1, 2, and 3 and were 11, 15, and 14, respectively. 

If school-i is a standby school, then 



1 



p . . = p. s 



1 Ki' 



aij ^ ^± 

^ 1 

where P is the probability that school-i was in the sample; ^ is the 

1 . 

probability that gxoi^ standby package-a was assigned to school-i; and 

/■ 

Min [n. . R 1/R is the prpbability that a particular student in school-i 
ai ' 1 1 

was selected to complete assessment package-a. The quantity Minln^, R^] 

refers to the minimum of the planned sample size for pacttage-a in school-i 

or the number of eligible students in school-i. 

If school-i Is' a nonstaiKlby school, then 

n . G. P. 
*^aij " N R^ ■ 

2.5.i2 Regular Assessment School Weights and Nonrespons e Adjustments 

School weights Vor 9-year-olds, iS-year-olds , and Tegular assessment 

• f 

17-year-olds were computed for Year 11 following previously defined proce- 
dures. School weights are appropriate for weighting data collected from 
atl students assessed, such as Background Questionnaire data. These school 
weights can be expressed as 
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A. R, • 



s. 

1 



1 ^ 



^ -i 



where 



A. 
1 



the combined adjustment factor for school and PSU nonresponse; 



P = the probability of selecting school-i = P(PSU) x 
i P (school- 11 PSU); 

^ R. = ^he number of eligible students in school-i; 

the number of resgondents. in School-i. 



a. 

1 

The value m. was computed as 

' G, 



1^ nl 



' where G. "is the number of group packages assigned to school-i and n^, is 
the number of respondents to package-a from school-i. . 
The combined adjustment factor. A. , for school and PSU nonresponse was 

calculated as ^ • 

7 p 1 if m. > 0, 

1 P. ' • 1 

. - _i and I. = , 

*i ~ o ^0 otherwise. 

-i 
^i 

la computing, the !ubscript-i indexes all sa^^e schools in the PSU. These 
for«il.. and specific nonresponse adjustment procedures are detailed in a 

working paper [2] . ^ 

2.5.3. FnllowuD Assessment Package Ve^ r . hf.:nd Nonresponse Adjustments 
A nonrespondent followup assessment of Year 11 Age Class 3 was con- 
ducted in March and April of 1980. Basically, the followup procedures 
i consisted of returning to .11 17-year-old sample schools achieving 'le.s 
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I. 

[ 
r 
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tban a 75 percent student response rate on a day following regular assess- 
aent. One or two packages for each Class 3 school had been designated as 
followup packages using prob ability sampling procedures.* When the Dist^rict 
Supervisor returned^ to the school, he administered the designated packages 
to a^l selected students who were located and had not been previously 
assessed* ^ * 

Development of weighting methodology* for 'followup respondents is 
documented elsewhere [3]; th^s section formulates. the weighting procedures 
associated with the Year 1\ in-schoql nonrespondent followup assessment of 
p * 17-year-old students. ^ 

For initial respondents^ (students who participated without followup 
I contact) in followup schools, package weights were computed as 

• V 

'P *ai(c) ~ ■ aij ai(c> ' * 

where F . ^ v is a weighting class nonresponse adjustment factor described 
later in this section. 

The weight formulation which follows is applicable only to respondents 
Vho did not initially participate in followup schools. Since there were lA 
distinct* group packages adainistered to 17-year-olds, thie weight for follow- 
up package-a adm;^nistered dn school-i to student-j is 

A^. lA R. ^ • P 

^ — JL Jl^ Y =/f 

K. ^F , ai(ci) aij ai(c) * 

i ai 



1 
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w^re 



P. = the -probability of selecting school-i = P(PSU) x 

^ P(school-ilPSU);^ ^ 

= the total number of,, students selected for group package 

- . administration in scho^l-i, namely, 



Go 
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t^e mufflber of f„n ' 
«i - t^e naufflber of eligible f^it ' 



F 

n . = 
ax 



* ^ - 1'.) 



- or weigbts fo. sa^i " 'be 

^ .espon.... ^ ^^^^^^^^ ^ ^ ^'-s- .be 3. 

A .i,b.i., - n .i,b. 



ax (c) 




where n la v 

^ ori tbe nu^nber of foUo 

• ■<■•' n«.„. ^ J" ^" 'Coo,.. („r ^ 

. «,.ul„j to'sifci^,, to io. ""Pl"» fraction 

^ , • - .^lnl.t„... • " '°»-P school. 

• ''uosets of n.' 
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considered based on region, size oflcommunity , and region by size of comraim- 
ity. All subsets were rejected because no subset contained at least 2 
schools where followup was planned to be condixcted.- 

i^S.A Follovttp Assessment School Weights / 

0 

2.5.4.1 Initial School Weights 

Initial school weights were formed by removing the number of respond- 
I ■ ents fro'm the regular school weight and substituting the number of students 



selected, i.e. , 

• • m. 

1 , 1 K. - 

1 ^ 

The value K. is the nuiflber of students selected from school-i and is 

1 . . 



^ computed, as 

aex ' 4 

where ^s the number of studeats selected from school-i for package-a. 
The compar^len Qonresponse adjustment is ^ 
K. * 

. ^ F ' • ) - • 

». + m. 
1 1 

F ^ . F . , 

where is the number of followup respondents^in schoal-i; m^ is the sum 

^ over all fpllowup packages; and n^^ was previously obtained by 

dividing the actual number of followup students assessed by the sampling 

-in^ival required to subsample to 40. The nonresponse adjustment is 

applied to the initial school weigjit to obtain ' 

K ,f.^m,l\,' m. # 

s^^ = s. ^ .= s 



1 m . m . m . + m . 
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2.5.4.2 . Followup School Weights 

The follovmp school weight can be expressed as 

- A. R. A S. m , 

^ = F r 7 " p. K " ^i K i 

1 1 R^ 11 If' 

where R^ = the number of eligible followup students in school-i. • Thus, 
the aonresponse adjusf.ed followup school weight is 

A. R. K. A R. lA 

^ *^i 1 m. + m . . 1 m. + m. m + m 

i i 11 11 

2.5,5 Documentation of Weig ht Computer Software . 



Tackage weights and school weights were calculated for each school 

that participated in National Assessment. Extensive editing of the input 

ij 

data preceded the weight calculations. JData obtained at the time of -ESU 
definition and selection were brought together with data collected through- 
out the assessment year to produce the weight files; the sources of data 
\ ranged from school princi4>als to Census files. The large volume of data 
processed during an assessment year required that efficiency and ease of 
use be prime considerations in file construction and data handling proVe- 
dures- The calculation of weights and the production of the weight ta^e 
were the final steps in the process. 

2.5.5-1 Master File Structure and Content . 
^ The roister file contains dat|a for all schools and districts selected 
" for Year 11. There 'is a single record for every unique school and district 
* record for every unique district in the sample. The master file is basi- 
- cally a aam« and address file; however, some additional information is 
coBtained <Jn the school records for each age class in which the school is 
to participate. 
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Machine readable tables were prepared describing the variables on the 
school and distric^jj<records , the positions of the Variables on the records, 
and the lengt^ of each variable. The tables are used as input to subrou- 
tines which r<?ad and update the data in the master file as requested. 

A district or random access method of procedding the master file is 
used; therefore, directories containing pointers to the various records are 
required. The directory of PSUs lias pointers tp the various FSU direc- 
tories, and the directory for a single PSU has p^ointers to the data records 

for the schools and districts in the PSU. 
] ] 

2.5.5*2 Data Preparation 

In preparation for the computation of wights, data must be drawn 
together from several* different sources. The data^ sources are elaborated 
in the sections which^ follow. Data were collected from the field and 
generated in machine readable form at RTI throughout the assessment year. 
When the assessment for each age class was completexJ, data were sent to RTI 
from DataScore for reconciliation. 

2.5.5.2.1 Principalis Questionnaire, Package Assignment, and School 
Worksheet Data Files 

.Principal's Questionnaire data were (iollected from the school princi- 
pals for every participating school and recorded on a disk file as input to 
the package assignment and weight programs. The data were edited *for 
consistency, and'^validity checks were perfonDe<i where appropriate. An 
example of the Principal's Questionnaire is included as appendix A. 

• r 

m 

A rcrcord was generated by the package assignment' program for every 

participating school. This record contained the package nu^ers which were 

to be administered in the school at the time of assessment. Upon comple- 

tf 

• tion of ' assessment in a school, the District Supervisor filled in and 

' ' ' 
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returned to Rti: a copy of the School Worksheet; aa example of the School 
Worksheet is included as appendix B. The data entered were as follows: 

(A) Package numbers for packages administered; . , 

(B) Planned and actual gackage sample size; ^ ' 

(C) Total number of eligible students ^in the school; 

(D) Number of , students -identified by the school as non-English 
* speaking, emotionally or mentally retarded, or functionally 

disabled; 

(E) Number of nonreaders; 

(F) Number of Student Listing Forms (SLF). 



A disk file was created containing the laformation extracted from t^ 
School Worksheet. The allocation of packages indicated on the School 
Worksheet file .was Icompared with the assignment generated by the package 
assignment pr6gram; inconsistencies were riesolved. Consistency ch|^cks were 
'JRso performed! on the number of sample students. 

2.5^.2.2 Data Frpro DataScore . 

Data tapes containing the sample^ size .^^ordted by DataScore were 
received at RTI. T^ 13-, 9-, and l'7-year-old tapes were receive^ on 
"February 26^ April 7, and June 23, 1980, respectively.' DataScore* s data 
tapes were cjompared with RTI's School Worksheet data files for consistency; 
discrepancies w^e corrected as appropriate. 

2.5.5.2.3 Nonresponse Adjustments for Lost Packages . 

When a package was assigned tor a^ school in which age class eligibles 
wcrfe present but no packages were administered, th^'^j^^kage was considered 
lost. ^ Ap adjustment for the lost package was made to the package weighty 
for that package in another school where the package was administered. ' The 
adjustment was made to, the appropriate package weight in another school in 



the sacKS fSC.or to a school in another PSU. Specific computaj^ional pro- 
cedures for aaking these .nonresponse adjustments are rffo'cumented else^.here 
12]. 

2.5.5.2.3.1 Input . 

Input required for the^ computation of nonresponse adjustments for lost 
packages included the master file,, the tables 'and directories needed, for 
processing the master file, the package assignment data, the School Work- 
8h|eet data, tand a table of PSU selection probabilities 

2.5.5.2.3.2 Output . 

The- output from the, "computation of the nonresponse adjustments was a 
file of variable length records containing the PSU number, the package 
number, and the adjustment for each package where appropriat^r. V addi- 
tion, a table was . printed listing component parts for each adjustment 
factor^ 

^ 2.5.5.3 Weight Computatiops . 

A package weight was computed for all packages whi^h were adaini- 
stered; a school weight was coi^puted if a school had at least"one respon- 
.detit. Calculation of the weights took place after all basic editing of the 
input data had been completed; in addition, a final edit was perfonned at 
the time th^ weights .were calculated. , . . ' 

2.5.5.3.1 Input. 

— — • f 

Thfc computation of weights required: (1) Principal's Q^estio^aire 
data, (2) package assignment data, (3) School Worksheet data, (4) the 
-aster file along with its associated tables and directories, (5) PSU 
selection probabilities ,. abd (6) nonresponse adjustments 'when necessary. 

2«5.5.3.2 Output . 

The prijnary output of the weight computation'procedure- was the prelim- 
inary weight file containing one record for each package administered. A 
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summary of the weight calculations and selected data items for a school 
%«rc printed by PSU. ^In addition, any errors that were detected in the 
data were indicated in a printout. Also, a list of refusal schools was 
printed so that a final ch^ck could be made as to whether appropriate 
nonresponse adjustments had been made. 

2.5.5.4 Weight Distributions , ' , 

Once the preliminary weight file had been generated containing a 
package and school weight for each i^ecord, a subfile of school weights va-s 
produced containing one record for each school in which a package was 
administered. Each of these files was used as input to the weight distribu- 
tion prograa. 

2.5.5.4.1 Purpose 

The ordered listing of weights by package provided a means of easily 
.spotting large and small weighty. Statistics such as sample size, mean, 
standard deviation, etc, were computed for each package. 

2.5.5.4.2 Pxocedure % ^ 

The j^ile was sorted by package and magnitude of weight before it vas 
used as input to . the weight distribution program. Sums of weights and 
numbers of respondents were calculated for use in computing the required 
statistics. A printout by package wa^ produced with the following items 
listed for each /school :*. (1) PSU number, (2) scl^ool number, (3) number of 
respondents, (4) package weights, and (5) indication of standby status. 
Statistics and a frequency distribution ^ere printed for each package. 

2.5.5.5 Final Weight File 

At this point ^e r^iftaining updates to data on the weight record were 
made. Errors detected during the calculation of the weights and generation 
of the preliminary weight file as well as errors detected in the weight 
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distributioas were corrected. Once these changes had been made the result- 
ing file constituted the final weight file. 
2.5.5.6 Data Distribution 

RTI maintains two copies on tape of the package assignment file, the 
PrincipJb.'s Qiii^stionnaire file/ the School Worksheet file, and the final 
weight file. In addition, a tape of the final weight file for each age 
class was mailed to DataScore. DataScore then merged /the weight and 
response data tapes. A copy of the final merged tape was mailed tg National 
Assessment staff. Weight tapes for 13-, 9-, and 17-year-<Ti4s^ were mailed 
to DataScore on April 9, April 29, and August 15, 1980 respectively . The 
format for the Year 11 weight tape is included as appendix C. 
2.5.6 Weight Computation Results ' 

Tables 2-15 through 2-19 summarize the s^le siies for^ the packages 
at ,each age class. They also list the sum of the weights far each package, 
the average weight, the standard deviation, and the minimum and^ maximum 
weight for each package. Seventeen-year-old summaries are deluded for 
regular, initial, and followup respondents. 'In each case, the classifica- 
tion is for all schools and for standby schools only. The sua) of the 
weights for the "all school" classification for each package is an estimate 
of the target population for each age class. An average of these weight 
sums represents another estimate- of the target population. Similarly for 
the standby schools, the sum of weights for each .package is an -estimate of 
the target population in standby schools. Taking an average, of these 
separate estimates yields an estimate of the target population in standby 
schools. These estimates are summarized in table 2-20. Since the popula- 
tion and sample percentages in table 2-20 are relatively close, the sample 
appears to represent students fro© standby * schools in proportion to but 
. slightly , lower than the population proportions. 

7^ • ■ - ^ 
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2-15. ^unmiary of 9-year-old package weights in Year 11 
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tabie 2-16. 



Sunnnary of n-year-old package we/ghts in Year 11 



STANDBY SCH00l,S 



AU SCHOOLS 



NUhBEd sue NfclttMTS 
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MEIGHT 
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27J| 3a2'50«T, 

2742 xl«522Qb. 

27«4 3342010. 

2786 3367875. 

277? 337272«. 

29|i 3352280. 



1217, 
t2«3. 
tt76. 
i|82. 
1208. 
llS3. 
1220, 
1126. 
lt*3. 
1254, 
1259. 

1216. 

1209. 

121'7. 

llSO. 



715:77 
899.99 
66'';02 
705. 50 

••26. 7« 
707.'«7 
67«.33 

f7t.21 
869.73 
80».96 
•31. 8« 
'6JV.98 

fl2.«^ 
596.58 



HiNIHUH 



188,75 
201.0* 

lao.is 

|7l.*^ 
157,2?^ 

175, l» 
,90,5? 

175, '2 
238,16 
175.06 

175, H 
182,3? 
187,56 

161. »! 
187,56 



HEIGHT 



6305, 31 
J0957,22 
6669.33 
6220.25 

5l0».'* 
6844,81 

655'. 
6678,06 

606*. 6' 
7794.85 

U372.12 
•742.32 
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Table 2-17. Summary 
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a| 17-year-old regular respon^dent package weights in Year 11 

^ . • • • STAMD8Y SCH03LS • • ' 



1HPW?3. 1263. 

I'IM'.CS. 122***. 

r^3b'i'>7. 1M7. 

;«*6Hih2. 

109^«*?3. 117b. 

i8?HHH*. 1U2. 

?:i70f.3., 1225. 

lK27y<iS. IXCl. 

19BH10. It^i*. 

189*39*. I?r3. 

;i*02^. UC3. 

t k3^ 721. n??# 

Itri^Tl*. 11*2. 

211$CP7. 1?%3. 



ST Af.D*>tn 
DEVUT ION 



11M.32 
1 138. 73 
Ui$.?3 

7r*.9i 

*H.30 

i:**.t<* 

0 79. :»c 
7 n . **i 

1133. 3C 
Kf>6.22 
b*C.r3 
*5A.e6 

1C76.C6 



WEIGHT WE ICHT 



PACKAGE SMPLE SUH OF A^E^^A&E STANDARD MniHJM ^^XMUM 
nJ^SE; Size JlGHTS W-IGHT DCVI^ION W-UHT ..r.HT 



?71 .5? 
r71 .^.2 
.''53.33 
197.97 
271.52 
23C.0b 
^23r.»9b 
'IM.^7 
2^^P. *1 
2 07 . K7 

16f..2* 
26R.;* 
2C7.r7 



9iai.97 
1CHC?.31 
10?'^2.18 
*722.1* 
3Ct;:.39 
, 2'**3.fe0 
lC20?.lft 
35')3.58 ^ 
£572.77 
ir2C2.1 B 
t.f.65.78 
39M9.71 
3137*91 
H?C2.ie 

















01 


12 


38388. 


5199. 


J. 38 


319P.93 


51 9H. 9H 


r2 ^ 




*1*6*. 


2*39. 


2095.29 




3:C5.95 




&9Q3U. 


^158^ 


1*C 


2 2.2.8) 


51 *:. 9S 


0* 


^ 10 


29765. 


2^77. 


2*5 5 5 . 


590.72 


*307. y* 




0 


D. 


n. 




c.:? 


/ . a 


OS 


& 


I31li7. 


219B. 


D.27 


2197.75 


2197.75 


C7 


u 


3673*. 


3559. 


3.S8 


3 319.*^ 


333?.** 


OS 


* 


1573. 


393. 


D.2* 


3M3.32 


39! .32 


>3 


0 ' 


D. 


n. 




0.0 




ID 


1* 


**01&. 


31**. 


222^.5* 


SSB.79 


3 ::•:.* 5 


H. 


13 


5259. 


. *0*. 


0.2* 


* C * . * 3 


* 'j ^ . * s 


12 


1 


*000 . 


0. 


no * 


3999.71 


5999.71 




n 




C * 


3.0 






1* 


0 








' G.D 


CO 



I 
J 



ERIC ' 



to 



f 1 



:j3 

-.5 
.i 

r. 
11 
1? 

15 



ERIC- 



7 i9 
77? 
7 4 3 
817 

8ia 

7fJ% 
771 
7Bi 
B31 



\ 



o 



<tlU SCHOOLS 



uriGMTS unCMT 



ill%>.M. '123^. 

ICUl 189.^ 126 

1.9?r.lS. 1337# 

l'*^!?^?. 128A. 

990^;>6. Il&l* 

vll37'«>f,*. l%51. 
1 r>^^30» 



ST ANOAJ^O 
DLVJATION 




1 t5l. 17^ 
59^.83 
i 5%8.26 
^Al.32 
,1235^;S8 



«f27 7t>*. *iia'>. 
1 122^7!i.* 13SU 



1199.69. 
^ A »^ • 5 0 
1 ObO. 8^ 



V 



af 17-year-old 


initial respondent package weights in Year 

r. 


11 












* 










MAXIMUM 




SUM Of AV 




STAN)A^O 


M t I M J ^ 


^ A X I *1U*< 


WCICMT 


VC1GH7 






WGIGMTS Mi 


IGHT 


OCVIATION 


WC IGHf 


rfClCHT 






















232r.lft 


. 01 , 


0 ' 




t. 


^ n 
J . U 


c. : 


. 3 




6626.^1 


l2 


0 


0. 


0. 


3.0 


n n 

W . 'J 


# .0 


138. ^•^ 


29b?. 09 




c 


^0. 




3 . C 


r . ? 




153.12 


2b2^. 6^8 


0^ 


0 


0. 


' G. 


5.0 


t. 0 


n. 0 


1A^.H7 


51 89.66 


35 


1 


5190. 


n. 


3.1 


5 1 B9 . S 3 


51 09. S& 


157.f'2 


2551^61 




0 


i 

C. 


0. 


3.0 
* 


0. n 


- 


M5« 7% 


8!»21. 16 


n Y 

0 f 


(t 

w 


0. 


G. 


n.o 




• : , 0 


153.25 ^ 


362**. 5hP 


OS 


0 




c • 


3.3 




'J. 3 


217.^^0 


3523.29 


09 




D . 


0.* 




c.c ^ 


' - 




'2621. 2 3 


-ID 

- t 


0 ' 


0. 


0. 


43.0. 

* 


0 . ? 


CO 


21^.12 


ICOI 1.63 


' V 

11 


0 


> 

0. 


. n. 


0.0 




CO 


233.32 


- 8893.72 


12 


0 


0.' 


n. 


'J . w 


0.3 

* 




l?2.1l 


2905^78 


li 


0 


0. 




; . 0 


P.l 


:.o 


tt\» R6 


^ '9315.52 


1% 


p - 


0. 


0. 


3.0 




'. . 0 














• 












♦ 


y * 
























• 






























* 


















0 














* 


















• 

































I 
I 




1 
U 
1? 

1% 



Table 2-19. Sunmary of 17-year-old follovup respondent package weights in Year 

• • • « ILL SCHOOL*? . • . • X 
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Table 2-2q\ Comparison of population and sample percentages 
^ia standby schools ly age class 




Category 

9-year-olds . v 

13-yeaV-olds 

17-year-olds 
te^xil'Br respondents ^ 

17-year-olds 
initial respondents 

17-year-olds 
followup respondents 



Population 



Average 

All 
school* 


weij^ht- sum 

Standby 
schools 


percentage 
in standby 
schools 


All 
schools 


Standby 
s cnoolo 


3,339,332 
3,298,143 
1,957.038 


41^544 
61,794 
20,244 


1.2% 
1.9% 

i!o% 


29,103 

41,574 

22,529 
t 


146 
196 

no 


1,029,567 


371 


* 
0.0% 
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11,085 




244,305 


^ 20\ 


y 

^ 0.1%. 


^,495 


1 



Sample 
percentage 
in standby 
schools 



0.5% 
0.5%" 
0.5% 



i- 



0.0% 



0.0% 



I 
I 



Less than 0.05%. 
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ERIC 



-r,. ,ctu.l s,.pl. s,.» co.p.rea .Uh .he pUn^.d sample siz« 

... .0.^ - - ^'"- r 



4, 



sample size. ► 

■ /, Size -.isht fo. ,11 .chooU. Separate' taMes a.e presented 
weights ¥y size oi w « , ^ ^ear-old initial 

.„;Xp ...PO.-S, The =ac. pa.a. a„ ...e.s 

\ ' • >,fc f«Jl Within the specified range, 

respondent^ for the p^kage wh^e weights .f<^l wi^ ^ 

■' distributions for respondents 

Tables 2-27 through 2-31 s*ow ^^mparable distrxb 

\ •, All nackaee weights in excess of 7,000 
selected froi standby schools Vnly. All package g ^ 

u •, ^v,.^ 100 are documented in TabTes 2-23, Z-JJ. . 
and all package weights less than 100 are^ . ^ 

* . • .^cess of 600 and all school weights less 

and 2-34. AH school weight.s m excess 

tU 10 ar. also docun,ented in these .tables. r 




Package 



Table. 2-21. Sumary of planned and actual saiifde si^ 



Year U ff National Assessment 




Planned 
sample 



Actual 
sample 



number 


size 


size. 


■ 01 


2592 


2609 


02 


2592 


2673 


03 


,2592 


2613 


04 


2592 


2648 


05 


25 ?2' 


2627 


06 


2592 


2620 


07 


2592 


2667 


08 


2592 


2665 


09 


2592 


. 265D 


10 


2592 


^ 2711 


11 


2592 


2620 


12 


NA 


NA 


13 


NA 


NA 


14 ' 


*^NA 


NA 


15 


NA 


NA 



Percent 
difference 



Planned 
sample 
size. 



Actual 
sample 
size 



. Percent ^ 
^difference 



Planned 
sample 
size 



Actual 
sample 
size 



Percent j 
difference 



^3% 

^1% 
^1% 

^5% 

NA 
NA 
NA 
NA 




(Actual sample size - PI 



ann 



cd saropU 8ize)/Planned sample size. 



G J 



' » AO 




2592 


258^ 


-.0% 


^1 h 




2592 


25^.5 


-2% 






2592 


2580 


-0% 


+6% 




2592 


' 2546 


-2% 


+5% 




2592 


2608 


+n 


+6% 




^592 




-01 


+5% 




2^ 


2579 


-n 


+5% 




2592 


2611 


+1% 


+10% 




2592 


2502 


-3% 


+5% 




259^. 


2523 


-3%' 


+6% 




25'92 


• 2578 


-1% 


+6% 




2592 


2595 


+ 0% 


+ 7% 




2592 


■ J637 


+2% 


+ 7% 




2592 


2633 


" +2% 


+12% 




NA 


NA 


NA 
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Table. 2-22, Frequency distribution in number of respondents for 9-year-old package weights in all Year 11 schools 
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B2 ■ 
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37 
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C2 
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'59 



15P 



M8 
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03 



0* 



05 



07* 



0;. 




3^; 
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3f*» 



9?>n 
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9^:> 



b3l 



71 7 



9}* 



^91 



b77 



7 15 



37b 



«no 



325 



359 



211 



1 H9 



151 



232 



11^ 



136 



33 



80 



53 



7^ 



^5 



7% 



108 



91 



7^ 



7^ 



39 
0 
17 

i% 

15- 

75 



18 
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21 



33 



A9 



C9 



^7? 



759 



176^ 



32 



68 



22 



10 



1 1 



260 



335 



10^4 



P08 
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r63 



3b6 



1?* 



71 



63 

/ 
^2 



47 

136 



22 
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— cz: 



Table 2-23, 
NUmBEr 

01 

02 
03 
ft* 
05 
06 

> 
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tooo.« 


1SOO|« 


2oOO,« 


2^*^ 


3000 , • 


4000 > 


500 0 1 • 








s fl o o 
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i . • 
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^999, 
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0 210 


925 ^ 


971 




Ill 


24 


62 


29 


0 


0 




866 


97J 


430 


93 


36 


37 


47 


0 


0 


320 


9l2 


955 


30^ 




55 


75 


2 


0 


n 
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1031 
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360^ 


^1-^0 


33 
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0 
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901 \ 


97>^ 
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80 


57 


20 


44 


9 




258 


|05« 
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82 
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3 


9 


# 
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0 
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3 


0 
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71 


51 


13 


to 


29 


0 
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933 
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a25 


65 


37 


15 


13 


30 
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27 
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23 
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20 
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0 
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12 
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0 
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Table 2-29. Frequency distribution in number of respondents for 17-year-old 
regular respondent package weights in Year 11 standby schools 
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' Table 2-24. Frequency distribution in numb^ of respondents foi;^ 17-year-q.ld 
tegular respondent package weights in all Year 11 schools 
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Table 2-21). ^Frequency distribution in number of respondents for 17-year-old 
initial respondent package weights in all Year 11 schools * 
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Table. 2-26. Frequency distribution in number of respondents for • ^-yearrold foUovup 
Table. ^J^^^^Zt package weights In all Year 11 schools \ , , 
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•28. Frequency distribution In number of respondents for 13-year- 
package weights In Year 11 standby schools 
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Table /2-30. Frequency distribution in numbei^ of respondent| for 17-^year-oid . ' ' / 
initial respondent package weights In Year 11 standby schools ^ ^ 
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Table 2-31. Frequencr^lstrlbutlon in number of ^espondet^ts for y7-year.old followup respondent package 
weights in Year 11 standby schools , . . . 



I 

00 



/ 



OMITTED DUE TO CONFIDENTIALITY ' 




r 



V 



11 



/ 



/ 



X i. 



ERIC 



^ ^ Table 2-32 - / ' . 

Exp.laoation for small and large package' and fichool weights for 9-year-olds ' in Year U 
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■■ Table 2-33- . ' • , 

Explanation for small and large package and school weights for 13-year'-ol^s in Year^ 11 
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Table 2-i3 

package and school weights for 13-year-olds in Year 11 
(continued) ^ r ' 
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Explatiations Idfr small and large package and school weights for 17-year-olds in Year 11 
. / ' Table 2-3A 
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ExpUnationi for s«all and large package and school weight, for 17-year-olds in year 11 

<continued) 
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Tables 2-35 through 2-38 are frequency distributions of school weights 
in number of respondents for all schools and standby schools. Classifica- 
tion is by^-, 13-, a'hd 17-year-old regular respondents and by 17-year-old 
initial and* followup* respondents. The tola! numbers of respondents for 
these classifications according to tables 2-35 through 2-38 were, respect- 
ively , ^29 , 103 , 41,574, 22,52.9, and 13,580. These totals agree , with the 
sample size totals in table 2-20. All school weights in excess of 600 and 
all school weights less" than 10 are documented in tables 2-32, 2-33 and 
2-34. The sums of school weights for the age classes are "suianarized in 
table 2-39. These figures were extracted from tables 2-35 thrxjugh 2-38. 
The figure ip each case is an estimate of the age class target population. 
It can be seen from this table that the weights estimated 103, 97, and 96 
percent of the 9-, 13-, and 17-year-old target population, respectively, 
estimated from Census data. 

The proportion correct Responses to NAEP exepcise-k can be estimated 
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*alk ' number of students ia school-j taking exercise-k in 

package-a; .1 
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Table 2-35. Year 11 school weights for 9-year-olds 
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Table 2-36. Year 11 school weights for IS-yeat-olds * 
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Jable 2-J7. Year 11 schools weights for 17-year-old regular Respondents 
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Table 2-38* Year 11 school weights for ^17-year-old initial and followup respondents 
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Table 2-39. Proportion of target population estimated 
by Year 11 sample' 



9-year-olNds 



1970 Censiis estimate of 
total population 

Proportior^ of age class 
enrolled in school 



Proportion of age class enrolled .99 
who are in grades surveyed 

Proportion NAEP-eligible* .96 

Target population es'timatp * .3,253,932 

from Census data ^ 

Target population estimate* • 3,339,332 
from school weights 

Proifortion of target population 1.03 
estimated by sample 
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estimated from Year 09 data. 
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= If if student-j's response to exercije^ In package-a 
administered ^ in school-i was ceTFrect; 

0, otherwise; 

= the weight for the package-a containing exercise-k 
administered in school-i to student-j; 

= the total number of schools whijre th^ package-a 
containing exercise-k was administered.. 

The effect of unequal weighting on the variance of NAEP estimates^. ^/ 

can bfe* approximated by the following ratio: 
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where n is the package sample size, i.e., 



\ 



This statistic approximates' the unequal weighting effect of. t^ NEAP^ design 
^ coejpared to a self-weighting sample. Ideally, the • ratio should be 
l.OOOl). Table 2-40 lists this ratio^or eacl^ package at each age class. 
The r^tio ranges .from 1.1612 to 1.9014. Thf^ average ratio, is 1.5415, 
1.3634, und 1.4773 for 9-^ 13-, and 17-year-oldsV respectively. 
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2-40. Unequal weighting effect 
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2.6^ DOC, TOC, and STOC Classif icatioa df Schools 

National Assessment reports results by the following seven, size and 

type of community (STOC) categories: extreme rural, low metropolitan, high 

metropolitan, main big city, urban fringe, medium city, a.nd small places. 

These categories are defined in Table 2-41. Assignment of NAEP respondents ' 

\ 

to STOC categories is a form of poststratif ication by school based on (1) 
size and ^location of place as determined from Census data, maps, and 2iIP 
code information, and (2) estimated percentage distributions of Students by 
location of l^ooto comnmnity and parental occupation category. In the determi- 
nation ^f STOC categories, sample schools were' first classified by derived 
size of community (DOC)-, a set of four categories based on size of place 

0 

and location with respect to urbanized areas of large cities. In order to 
identify spools in the three extreme £ypes of cotkiunity, each school w^s 
assigned to one of four TOC categ^ies . Th* STOC classifications were made 
by considering the DOC and TOC classifications together. Detailed descrip- • 
ticn of procedures for determining DOC, TOC, and STOC classifications 

follow in section 2.6.1 through 2.6.5. Results of the DOC, TOC, and STOC 

- <\ 

classification are reported se*parately by age class in section 2.6.6. 
2.6.1 ^ 

The following definitions otDOC^were used in Year 11: 

Code Class LimVts 

1 - Big City (BC) Within the city limits of a city with 

^ ^ population!^ greater than or equal to 

20b,000; within the city limits of* one 
' of two or more central cities of an 

urbanized area (UA) with combined popula- 
tion greater than of equal to 200,000. , 



2 y< Urban Fringe Outside the city 'limits but within the 

UA of a Big City (BC). 
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Table 2-41. S'attonai Assessment 



J 



size 'aid type'* of 



ccmmuaity (STOC) reporting categories 



.Size . and type of 
community ^STOC) 
" categories 



Reporting 
category 



Description 



1 



5 ' 



Extreme rural 



; Low metro 



High metro 



Main big city 



Urb^n fringe 



Medium city 



Small place 



Sanrple schools oC^ segments in commlnities 
with a population less than 10,000 and in 
the 90-99th percentiles of the extreme 
rural index. 

Sample schools or se^ents in a city^^ or 
the urbanized area of a city with a popula- 
tion greater than 200,000 and in the 90- ^ 
99th percentiles of the low metro index. 

Sample schools or segments in a city or the 
. urbanized area of a city with a population 
greater than 200,000 and in the 90-99th 
pecenfti'les of the high metro index. 

\ © 
Sample schools or segments within^ the city 
limits/ of a city with a population greater 
than 200,000 and not classified as high 
metro or low metro. 

Sample schools or segments in the urbanized 
area of a big city byt outside the city 
limits and not classified as low m^tro or 
high metro. 

Sample' schools or segments in a city with 
a population between 25,000 and 200,000 
not located i^i the urbanized area of a 
bij city. ^ 

Sample schools or segments in a community 
with a population less than 25,000 not 
located in the urbanized area of a big 
city or classified as extreme rural. 



* c - . P — 

Portions of Oris table excerpted from General Infgrmation Yearbook . .National 
• Assessment of Educational Progress, Report No. 03/04-GIY. December 197A. 

t / ^ 

The segments mentioned here relate to area segments from the household samples 
of youny adults conducted m Year 01 through 05 and Year 08. • 




' ft " 

In this table the tern "city" can also o>eaa twin oc triplet central cities of 
* an urbanized area. # 



^ 3 Medium City (MC) Within the 'city limits of a place with 

^ , . ^ tota-l population greater than or equal 

to 25,000 but less than 200,000; this 
• . , " place must- not be in the UA of a BC. 

4 Small Place (SP) Open count^ or a place with a total 

* population less than 25,000; this place 
* , Bust not be in the UA of a BC. 

2.6.2 TOC 

TOC codes were ass^igned on the bajjis of percentage . distributions 
,obtained,^roa Principal's Questionnaire "data, ^gether with" consideration 
of the DOC codes already assigned. An example If a PriaCipal's Questionnaire 
is Included as Appendix A. 

Answers <to Question 2 of the Principal's Questionnaire for each .ag«^ 
class provided principal's estimatei' of the proportions of the students 
living in each of three size-of-conmunity categories: 

Description 

A In a rural area (a total population .of less than 2,500). 

B i, In a place with a population of 2,500 to 10,000. 
• C In • place witk a population of over 10,000. > 

Repliea to Question 3 gave the principals ''» estioatTs of percegtages 
of parent* in each of six occupatibn categories-: * 
. Description 

A Pro£e«iioMl or aaiugerial personnel. 

B .S«ler, clerical, technical, or skilled workers. 

< 

C * Factory or other blue collar workers. 
• ' D Fans workers. 

E Hot regularly eoployed. 

~ T On welfare. . 
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For each of the three age groups, the following procedure was used to 
assign schools to the four TOC categories: 

^•^•^•^ Extreme Rural - tOC 1 . ,Each school was assigned a rural 
index, based on occupation percentages, DOC code, and size of community. 
■The index wa. calculated by the use of the .formula [D - (C + 2A)I; the' 
letter, represent the percentages coded from question 3 of Ae Principai'^s 
Qu«r,tionn.ire; hfgh value, of this index result from relatively high percent- 
age.^ of person, employed in agriculture and relatively low percentages in 
profe..ional, managerial, and blue c/ur jobs .subject to the constraint, 
that 

(A) the school had to be DOC 4; 

(B) the percentage farm workers had to be nonzero (Question 3. cate- 
gory D on the Principal,' s Questionnaire,); 

/ (C) the size-of-coomunity percentages had to be nonzero for rural 

categories except small town 
UMe.tion 2, categor^e. A and B, respectively, on the Principal's 
v^estiooixAire) . 

School, not qualifying were ..Signed indice. of (-200). School, were 
then arrayed in de.cending order of rural index with cumulative .ample 
<.i2e. recorded, and schools included in the first 10 percent of total 
.Mple .i^e were assigned a TOC code of 1. 

^•^•^•^ g»t:re»e Inner City - TOC 2. The .ame method u.ed for TOC 1 
u.ed for TOC 2. with the formula (E * F - A) providing high inner city 
Index value, for «hool. with relatively high percentage, unemployed and on 
.relf^re and relatively low percentage, in professional and managerial 
occupation..^ The" only conatraint was that the school had to be in either 
DOC category 1 or 2. j 

^•^•^•^ g«treme Affluent Suburb - TOC V The method and constraint 

tt«ed were the ...e a. for TOC. 2, with the formula (A - (C ♦ D ♦ E ♦ F)] 

I- 
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providing hiffh ^^*ri 

'^igh afflue^ .uburb indices for schools with , 
percentage, of nr«f . relatively Jrlgh 

Of professional and managerial personnel and , 
percentage, of blue. coll. . relatively low 

^, collar workers, agricultural workers u , 
person., and welfare recipients. -^"Ployed 

^•^•2.^ Otheri,^,^. Ali school, not assigned t 
- 3 were classified a. XOC 4. ' ^' ^' 

■2.6.3 STCX: ^ 



TOC 1 s STOC^i 
TOC 2 s STOC 2 

TOC 3 = STOC 3 /"^ 
DOC I ^ TOC 4 . 5T0C 4 / 
2 + TOC 4 « STOC 5 / 

joc 3 . itx: 4 = s?o^ r / 

^ * + TOC 4 » STOC 7 



^•^•^ yoraation »f ppc CaH., 



that the STOC c.tegorie. for Ye.r H 
ti^e b..ic iofor^uon for each . . 

' "d the replie. to th^ 

-V ... .... . .^^^^^ - 

» r 

^^^^°t Of DOT TT.ln, II , ' 

"•i-. . li.t Of PSU au.ber. .aTuTl^^Tl! ^ ^i^i^^OSOC^^. 

1« procedure - to be foil . """" 

to be followed for each PSU w.i h.. . . 

3" Wa. detemined and recorded. 
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' For each PSU classified as SOC 1» as iadicated by the second 

digit of the PSU aumber^ the DOC code was detenniaed oa the basis of post 

X 

office address » ZIP code^ ZIP code map^ census map of the urbanized area, 
and populations of places not in the urbanized area^ using the flow chart 
shown in figure 2-1. 

For each PSU classified ks SOC 2 or SOC 3» the t6tal population 
of the SHSA central city or cities' was ^pbtained from a 1970 census report, 
and for tbbse with cities having t^otal populations of 200,000 and over the 
same procedure was followed as for SOC iJ 

C. For 6ach remaining PSU classified as SOC <2 or SOC 3, names of 
places with populations of ^5,000 and over were obtained from a census 

-^report, and using a ZIP code directory, each place was identified as to 
whether it had a single ZIP code or more than one ZIP code; the names of 
the places and the ZIP xode information were recorded. 

1. All schools in places with populations of 25,000 or over 
having a single ZIP code were classified as DOC 3. 

2. For each, school in a place with more than one ZIP code, the 
ZIP code, the ZIP code map, and a map showing the city 
limits were used to e8tabj.ish its location; if the school 
was located inside the city limits, the claa^sif ication was 

^ DOC 3; if the school was located outside the city limits, 

the classification was DOC 4. 

3. All other schools were classified as DOQ 4. 

D. For PSUs classified as SOC 4 and SOC 5, county populations were 
obtained frbm census reports; for each PSU with every county under 25,000 
total population, all sthools were classified as DOC 4. 

E. For SOC 4 or 5, PSUs with one or more counties whose populations 
were 25,000 or over, the procedure for SOC 2 or 3 outlined previously in C 
vas used for the assignment of DOC 3 or DOC 4. 
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2-6-^-2 Assignment of DOC Codes Us ing Post Office Classifications . 
^ Using a computer printout of the nWs and addresses Withe sample schools, 
the subsequent instructions wer-e foll^jjed; 

A. Using a computer printout list, the following steps i^ere taken: 

1. Lines were drawn to separate and identify each PSU; { 

^- assigned procedure for each PSU was identified and 

recorded; 

3. For each school not requiring the use of a ZIP code, the DOC 
code was recorded at the left of the page just before the 
PSU number. 

I 

B. For each school not assigned a DOC code, 

1. The post office address (except names of SOC 1 central 
citieS^nd other obvious ones) was located in the ZIP code 

^ directory; 

2. If the ^st office address was a branch, e.g., "branch of 
Boston," then the appropriate branch name was recorded; 

3. (If the post office address was a st.atioa, e.g., "Boston 
Hation," then the appropriate station name was recorded; 

4. If the post office address was a "regular" post of f ice ' aad 

(a) If only one ZIP code was recorded, then a "1" was- 
recorded; 

(b) If mdre ttian one ZIP code was recorded, then a ">^" was 
recorded. . - - 

C. For each school not assigned a DOC code after step B, a location 
was Vdetermined as follows: 

1. If the school had been marked ">2", using a ZIP code map, a 
check- was made to see whether the school was located inside 
or outside the city limits of the place involved; 

If the school had been marked "1", it was assumed that thn 
school was located within the city limit? of the place; 

A DOC code was assigned on the basis of location: 

If th? school was located inside a cit^or UA conglome- 
rate with a population bf 200,000 or over, then the 
school was assigned a DOC code of "1"; # 



2. 
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(b) 



If the school was located eLsewhere* in th. riA u . . 
area of a Br mi„ *k «>cwaere in the UA shaded 

of '2° ' * "^"""^ assigned a DOC code 



(c) If the school was: located in a place of nnn 
^ population and not in a b? Jhrn^H ^' 

school was assigned a DOC code of "3" ' 

Th. DOC coa.. *,r. r„ord.. aisk ,l„„g 3,^„i 
tion data. ^ 

2.6.6 Fonnat^on of STOC Co-H^ s by 9 ompui^^ 

For the detcmnination of ^STOC classi f-.'^^i.,'^ 

oiv^ ciassificatipns on the basis of DOC 

cod.. ...1 -the re,u=r«.t. ol lOC .co*,. another ^o^ut.r j-rogr,. .„ „„„ 

which crried o^f th. op«.tion. .H:e.ay outlined. For each of th. TOC 

categories, the ifollowing^rocedure wd? used: , ' ^ 

^ A.- For each .cbo,! " th,^ apprSprfate "'i„d„ „a. calculated fr» th, 
occupational percentages ^ ^ ^ 

B. For e.Ch schoo^ requirement, for inclusion 

in the category, th. .^^^ v„ substituted 'for the calculated index. 

If Jer X '1 



"Hhe schools so treated ^ti^ 

1. For TOC 1, 'slf'tfCiioolg not in nnr / n 

f.r. worker parents aU !ci!oi k no 
In a- rural are. ?t«;.i '"^i"* no students living 

schools Lving .ny^Vtudrn?f^^^^^^^ '""^ 

tigns greite/thiriO.OOO °* "'^^ 

2. For TOC 2 -wr 3, aciiools not In nor i » 

was realized thatTvervToor 1 or 2. ^ Because it 

fo^ad outsile thU l7rg^ citTe. 5^^^^^^ 

affluent areas could H lllll\^T "aversely, 
as well as in their suS^rbr n" . ^ "^i" 

. 1^ ^ .nd DOC 2 in eJ^er di.tin^tion was «ade between 

. C. The schools - were ordered on the ba.i. of the^^ resulting 
valu..; .a^le siAs were accu^l.ted downwards; and the cutoff point was 
. _^ ,.t. to separaf ^t^ top la percent. Because ineligible school, had be.n 

ERLC i:^^ 
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moved to the bottom of t^e list, all of the schools in the top 10 percent 

were eligible, and no substitutions wereV^ecessary . 

Both the DOC and the STOC codes were recorded on disk and added to the 

weight record at the time th? weights were calculated. 

2.6.6 ■ Results of DOC, TOC. a nd STOC Computations 

~ i 

2. 6. -6.1 Age Class 1. 9-Year-OldS . Table 2-42 presents weighted and 

unweighted percentages of Age Class 1 %ligibles for STOC for all packages 

and provides comparisons of Year 11 percentages with 'those for Year 10. 

Unweighted percentages for STOC, 1 , 2, and 3 are not precisely 10 percent 

because STOC codes were determined for individual schools rather than for 

. individual respondents. Thus within each school all of the respondents 

were assigned tEe'same STOC code. It was not possible to~reaSsign STOC 

! 

|- codes within scl^ools so 'That exactly 10 percent of the respondents would be 

categorized as each of STOC 1, 2 and 3. Weighted percentages f#r ,STOC 1 

are lower than the unweighted percentages because of oversampling in rural 

ireas; sr^ilarlf STOC 2 and STOC 4 weighted percentages are lower than 

» 

unweighted percentages because low-income- urjian areas were oversampled ; 
other Weighted percentages are relatively high because of the resulting , 
udderiampling involved. 'The largest differences in both weighted and 
unweighted percentages for Years- 10 and 11 are the decreases for STOC 4 and 
^he increases for STOC 6 and STOC 7. Thpse changes can be attributed in 
part to sampling differences in the first-stage sample units. The primary 

4 

sample for assessment Years 07 through 10 was selected ^n Year 07. Primary 
units were assigned to years using a random^^'ocedure. The Year 10 sample 
received a relatively high proportion of primary units in cities of over 
200,000 population and relatively low proportions in smaller cities and' 
rural areas. ' . 

ERIC , 
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Table 2-42. Weighted and unweighted percentages of 
9-year-olds in Year 11 by STOC. for all 
packages. 



I 



* 


/ 


1 ^ 


, All packages 




3 

\ 


* 




1 ear 




Year 10 


Year 


11 


Year 10 

• 


STOC 


Unweighted 
sum 


Unweighted 
percent 


Unweigfited 
• / percent 

— 


Weighted 
sum 


Weighted 
nercen t 

W ^ w W W 


Weighted 


• 1 


2,924 


10. 0^ 


10.0 


321,457 ' 


9.6 


8 7 


2 


2,899 


10. p 


in n ' 

i 




6 . 1 


8.6 


3 


'2,893 




10.1 


345,564 


^0.4 


10.1 


4 „ 


2,693 


9.3 


16.9 


267,692 


8.0 


13.1 


5 


> 2,'871 


t 9.9 


9.9 


364,651 


10.9. 


10.5 




3,00k 


10.. 3 


9.4 


466,956 


14.0 


11.8 


7 


11,819 


40.6 


33.7 


1,368,391 


41.0 


> 37.2 


Jotal 


.29,103 


' 100.0 


100.0 


3,339,567 


100.0 


, 100.0 
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■When a new primary sample was selected for Year 11 to Year 14, anniXal 
region-by-size-of-conununity control was maintained when allocation to the 
four years was carried out. Table 2-43' lists Year 11 weighted , and unweight- 
. ed percentages of Age Class 1 eligibles by STOC fqr each of the seven 
packages. Percentages by SCTOC for each of the four NAEP regions will be 

♦ 

found ifi Table 2-60'. ^ - . 

Table, 2-44 presents Year 10' and 11 weigh,ted and unweighted percentages 
of Age Class 1 eligibles by DOC for all packages. Changes from Year lo 
again reflect the change in primary sample makeup; DOC 1 shows decreases 
froa Year 10 to 11 and DOC 3 and 4 show incrpses. 

Table 2-45 lists Year 11 weighted and unweighted percentages by DOC 
and package. Table 2-46 lists pe^entages of Year 11 Age Class 1 sample 
schools byJOC, TOC, and ^TOC classification. The 14.3 percent in STOC 1, 
which includes only 10.0 percent of the respondents, reflects the below- 
, average size of schools the extreme rural areas. In STOC 3, 5, and 7, 
school percentages smaller than respondent percentages indicate schools 
larger than average. 

f 

Table 2-47 shows comparisons of Year 10 and Year 11 weighted percent- 
ages of Age Class 1 eligibles cross-classified by STOC and DOC, using 
school weights. In each of the two years STOC^ 1 (extreme rural) was obtain- 
ed entirely from DOC 4 by definition. The major part of STOC 2 (low metro- 
politan) case froa DOC 1, with a lesser part fro« DOC 2. Conversely, the 
■ajor portion of STOC 3 (high metropolitan) came from DOC 2 and a lesser 
portion from DOC 1. STOC 6 and DOC 3 are identical, and STOC 4-, "S, and 7 
•re the nonextreme sectors oi-IJQ(L-V2, and 4. . Again, changes in percent- 
ages can be attributed to sample variabilities. 

er|c 111 
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Table 2-43 • Distribution of year 11 9-year-old 
estl-nated population and saTiple 
responde*nts by STCC and package 



Packaae no, 



STOC 


Estimate 


Perc ent 


Respondents Pe 


rcen t 


1 


393218.' 


11.3 


261. 


10.0 


2 


16765^. 


4.8 


23 4. 


11.3 


3 


344373. 


9.9 


24 6. 


9.4 




241238. 


6.9 


235. 


9.0 


5 


321163.. 


9.2 


242. 


9.3 


6 


4&968C. 


. 13.4 


279. 


10.7 


7 


1555409. 


44.5 . 


1D52. 


4(^.3 


tal ' 


3492735. 


IDO.O . 


26C9. 


100.8 



Package no. 2 
STOC Estimate 
248325. 



1 

• 2 
3 
4 
5 
6 
7 

Total 



176581. 

478958. 

238522. 

300527. 
. 827233. 
127480-3. 
3544989. 



Package no. 



Perc ent 
7.0 
5.0 
13 .5 
6.7 
8.5 
23.3 
36 .& 
100 . G 



Respondents Percent 



238. 
243. 
420. 
182. 
253. 
386. 
951. 
2673. 
V 



8.9 
9.1 
15.7 
6.8 
i-^9.3 
14,4 
35.6 
100.0 



STOC 


Estimate 


Perc j 


ent 


Re sponde^t s 


P e r c< n t 


1 


248383. 


' 8j 


. 1 


268. 


10.3 


2 


162948. 


5 


.3 


246. 


9.4 




264C39. 


sl 


*7 


185. 


6.9 


4 


■157072. 


6. 


t5 * 


218. 


8.3 


5' 


486823. 


16. NO 


368. 


14.1 


6 


328572. 


10. k 


248. 


9.5 


7 


1357911. 


4.4.6 


• .1385. 


41.5 


Total- 


3C45748. 


IvOO 


.0 


*2613. 


100.0 


Package 


no. 4 










STOC 


Est1 na-te 


Percent 


Respondents 


Percent 


1 


378415. 


10 


.2 


323. 


12.2 


2 


. 197545. 


5.3 


236. 


• 7.3 


3' 


. 426264. 


11 


.5 


313. 


11.8 


. 4 


312243. 


8.4 


297. 


li.2 


5 


371343. 


lu. 0 


249. 


9.4 


6 


561468. 


15 


.1 


320. 


12.1 


1 


1467S89. 


39.5 


940. 


35.5 


Total 


3714865. 


103 


.0 


2$48. 


100.0 



lie 
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T a D I e 


2-43 • 


(continued) 

— 




Pack age 


no. 5 


• 


• 




STOC 


Estimate. 


Perc ent 


Respondents 


Percent 


\ 


1 7 ft G - 


w . c 


17 ft - 




c 


9 A.Q X ? A 
c 0 H • 




C W i . 


o . o 


3 




12 • 9 


^ T n c 

3 05. 


11.6 


4 


2 C4113* 


6-. 4 


207. 


7.9 


5 


396299# 


12.5 


274. 


10.4 


& 


S26260* 


10.3. 


234 . 


8.9 


' 7 


14 19136» 


44.8 


1198. 


45. & 


Total 


3 1 70374# 


100.0 


2S27. 


1 DO . 0 












Package 


no. 6 






• 


STOC 


Zs tiaate 


Percent 


Respondents 


Percent 




286535* 


8.1 


249. 


9.5 


2 


254305. 


7.2 


288. 


11.0 


3 


389159. 


11.0 


314. 


12. C 


4 


252495. 


7.1 


« 205. 


7.8 


5 


251657. 


7.1 


190. 


7.3 


& 


550627. 


15.6 


296. 


11.3 


7 


1552223. 


43.9 


1078. 


41.1 


Total 


3536331. 


100.0^ 


2620. 


IGO.D 



Package no. 7 



STOC 


Estimate 


Percent 


I Respondents 


Percent 


1 


225191. 


7.3 


208. 


7.8 


2 


31873C. 


.10.3 


349. 


13.1 


3 


. 32fr68Ev 


10.6 


239. 


9.3 


4 


3:2710. 


\ 9.8 


'285. 


13.7. 


I 


^70809. 


\8.7 


203. 


7.5 




/4C0843. 


11. 0 


251. 


9. V 


7 


A2*5926. 


43^3 


1132. 


/ 42.4 
100. 0 


Total 


\3G90889. 


100>»T 


266/7. 



Package no. 8 



, STOC 


Es t1 sia te 


Perc ent 


Respondents 


Percent 


1 


449995. 


13.4 J 


272. 


. 10.2 


Z 


1578691 


4.7 


« 23G. 


8.S 


3 


317792. 


^9.4 


. 200. 


7.3 


4 


2^983 33. 


8.8 


332. 


12.4 


5 


474319. 


14.1 


284. 


ia.7 


6 


326649. 


9.7 


207. 


7.3 


7 


1344300. 


39.9 


1140. 


42.9 


Total 


3369257. 


100. 0 


-/ 2665. 


ICO. 3 
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Table 


2-43 . 


Pack age 


no* S 




STOC 


Estimate 


Perc e nt 


1 


163760. 


5.2 


2 


249324." 


7.9 




- 4 0.9162. 


12.9 


4 


2'C4113. 


6.4 


' 5 


398299. 


12.5 


& 


326260. 


10.3 


7 


14 19136. 


44.8 


Total 


3170074. 


100.0 


Pack age 


no. 6 




STOC 


Estiaate 


Percent 


•1 


286535. 


8.1 


2 


254305. 


7»2 

• • fc 




389159. 


11.0 


4 


252495. 


7.1 


5 


251651*^ 


7.1 




-5^0627. 


' 15.6 


7 


1552C23. 


4 3.9 


Tot a I 


3536801. 


100.0 


Package 


no. 7 




STOC 


Estimate. 


Perc ent 


1 


225191. 


7.3 


/ 1 


. 318730. , 


.10.3 


32668C. 


>10.6 




302710. 


9.8. 



.' 5 2 708 09.. ^ 8.^7 

/ 6 4C084 3. "is.O 

7 1245926. 40.3 

Total 3090889. 100.0 

Package no. 8 

STOC Es^tiinate P'ercent 

'^1 ' 449995. 13.4 

2 157869. 4.7 

3 , 317792. 9.4 

4 298333. 8.8 

5 474319. 14.1 
. 6 326649. 9.7 

7 1544300. 39.9 

Total 3369257. 100.0 



( cont 1 nued ) 



Respondent s 


Percent 


178. 


. 5.3 


231. 


- 8.8 


305. 


11.6 


2b7. 


7.9 


274. 


10.4 


234. 


8.9 


1198. 


45.6 


2527.* 100.0 

t % 


Re sp&n<pnt s 


■1 

Pe rc^nt' 


249. 


9.5 


288. 


ll.O 


' • 314«_ 12.0 


205. 


7.8 


190. 


7.3 


296. 


11.3 


1 078. 


41.1 




ICO.O 


Respondent s 


Percent 


208. 


7.8 


349. 


13.1 


239. 


9.0 


285. 


' 10.7 


^203. 


7.5 


251. 


/ 9.4 


1132. 


42.4 


2667. 

* 


100. 0 


Respondent s 


Percent 


272. 


10.2 


23C* 


8.5 


200, 


7.5 


ZZZi 


12.4 


284. 


10.7 


, 207''. 


7*3 


1140. 


4^.3 


2665. 


ICO.O 
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Table 2-43 • Icontlnued) 



Package no# 9 



STOC 


istlaate 


P ere ent 


Res 0 on'd e n t s 


9 • P» n ^ 


1 


46Q656. 


11.1 


353« 


13. 3 


2 


141347. 


4.0 


233 • 


7-7 


3 


237812. 


6.8 


250« 


*9.4 


4 


364293. 


1 C . 3 


J 278# 


10« 3 


5 


4.09778. 


11.7/^ 


260 • 


9.8 


6 


563331. 


16. r 


253. 


9.S 


7 


1339539. 


38. 1 


1 053. 


39.7 


Total 


35 16756. 


100.0 


» 2550. 


1 00« 0 


Pack age 


no. 10 








STOC 


Estimate 


Perc ent 


R e soon dents 


Percent 


1 


.4C1535. 


13.0 


3^3« 




2 


191972. 


6.2 


279. 


1 0 • 3 


3 


358477. 


11.6 


221 • 




. 4 


287806. 


9.3 


254. 


9a 4 

^ • ~ 


- 5 


355279. 


11.5 


322. 


1 1 • 9 


6 


437388. 


14.2 


' 290. 


10.7 


7 


1054730. 


34.2 


1 002. 


37.0 


Total 


3087185. 


100. 0 


2711. 


100.0 


Package 


no. 11 








STOC 


Estlnate 


Perc ent 


ReSDOnd^nts 


? p» r r 9 n ^ 


1 


2799?V2. 


8.9 


^ 231. 


ft • A 


2 


235142. 


7.4 


^ 330. 




3 


^248442. 


7'. 8 


^ 205. 


7 - ft 


♦ 


245788. 


7.8 


V u • 


7^ ^ 


5 


3 7116(7. 


11.7 


226. 


ft « & 

^ ^ O • 9 


6 


344467. 


10.9 


240. 


*9.2 


7 


1440935. 


45.5 


1188. 


45.4 


Total 


3165933. 


100.0 


2620. 


ICO.O 


All packages 




* 




STOC 


Estimate 


Percent 


Respondents 


'ercent 


1 


321457. 


9.6 


2924. 


10.0 


2 


204856. 


6.1 


2399.. 


10.0 


3 


345564. 


10.4 


2393. 


9.9 


' 4- 


267692.- 


8.C 


2693. 


9.3 


5 


364651. 


10.9 


2871. 


9.9 


6 


466956. 


14.0 


33C4. 


10.3 


7 


1368391. 


' 41.0 


11819. 


40.6 


Total 


3339567. 


Jfc.o 


/ 291U3. 


ICO.O 



-luJ 



4r 
9 
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Table Weighted and unweighted percentages of 

^ 9-year-olds in Year 11 by, DOC for all 

packages . 





« 

f 




All packages 










Year 


~ *. 


Year 10 


- Year 


11 


Year 10 


DOC 


Unweighted 
sua 


Unweighted 
percent 


Unweighted , 
percent 


Weighted 
sun 


. Weighted 
percent 


Weighted 
percent 


1 


6,403 


22.0 


29.0 


582,615 


17.4 \ 


23.5 


2 


4,953 


■ 17.0 


11.8 


600 , 148 


^ 18.0 


18.8 


3 


3,004 


10.3 


9.4 


466,957 


14.0 


11.8 


4 


14,743 


50.7 


43.8 


1,689,84/ 


. 50.6 


45.9 


Total 


29,103 


100.0 


100.0 


3^,339,567 


100.0 


100.0 



Hi) 
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Table 2-45 • Distribution of year 11 9-y?ar-oLd 
estifnatea population and saTiofe 



- 


respondents by 

- ^ 


OOC and paelcage 


^Package 


no* 1 








.DOC ■ 


LStiaate 


P ere ent 


Respondents 


r cent 


1 


4673 OC. 


13.4 


578. 


'22.2. 


2 


6C7128. 


■ 17.4 


439. 


16.8 


3 


469680. 


13.4 


279. 


ID. 7 




1 948627, 


55.8 


1313. 


50.3 


T^tal 


3492735. 


lOu.G 


2509. 


100.0 


Pac k age 


p 

no. 2 






DOC 


Estimate 


P ere ent 


R e s D on de rtit s 


9 A r r t 


1 


619920. 


17. S 


^ - 602. 


22.5 


2 


574708. 


16.2 


4 96. 


19.6 

^ «J V w 


& 3 


827234. 


23.3 


386. 


14.4 




1523127. 


43.0 


1 1 89. 


4 4.5 


Total 


3544989. 


100.0 


2673. 


100.0 


P ack agje 


no. 3 






• 


DOC 


C^tlaate 


P^erc ent 


Re sponden t s 


P e r e en t 


1 


4931 07. 


' 16.2 


516. 


19.7 


2 


617775. 


20.3 


496. 


19.0 


3 


328572. 


• 10.8 


248. 


9.5 




1 6 C62?4. 


52.7 


1353. 


51.8 


TotaT 


3045748. 


loe.o 


2613. 


100.0 


Pac'k age 


no. '4 








DOC 


Estimate 


Perc ent 


Respondents 


Percent 


1 


660353. 


17.8 


592. 


22.3 


2 


647041. 


17.4 


473. 


17.9 


3 


561468. 


15.1 


320. 


12.1 




1846003. 


49.7 


12&3. 


47.7 


Total 


3714865. 


100.0 


2648. 


.100.0 


Package 


no. . 5 , 








DOC 


Estimate 


Pere ent 


Respondent s 


=»er eent 


1 


,565255. 


17.8 


4 85. 


18.5 


2 


695^43. 


22. C- 


532. 


20.2 


3 


326261. 


10.3 


234. 


8.9 




1582915. 


49.9 


1376. 


52.4 


Total 


31-7S0-74. 


100. C 


2627. 


130.0 



Table 2-4i . 



Package 


'no. 6 




DOC 


Estimate 


P ere ent 


I 


571821. 


16.2 


2 


575795. 


16.3 


3 


550627. 


15.5 


, 4 


1838558. 


52 .0- 


Total 


3536dCl. 


100. a 


Package 


n04 7 




DOC 


Estimate 


Perc ent 


1 • 


725771. 


23.5 


2 


493158. 


15.9 


3 • 


4C084.3. 


13.0 




1471117. 


47.6 


Tot*l 


3290889. 


130.0 


Package 


no. 8 




DOC 


Estim-ate 


Perc ent 


1 


593374. 


17.6 


2 


6 5443 9-. 


i9.4 


3 


326649. 


9.7 


4 


1794295. 


53.3 


Total 


3369257. 


1001.0 


« 

Package 


njj^. 9 




OOC 


Estimate 


Percent 


I 


536779. 


15.3 


2 


■ 616451. 


17.5 


3 


563332. 


16.0 


4 


18C0194. 


51.2 


Total 


3516756. 


ICC.O 



Package no. 10 

OOC Estimate Percent 

1 651256. 21^1 

2 5422-78./ 17.6 

3 437388. 14.1 

4 2456263. 47.2 
Total 3C87ia5^ 100. 0 



( con 1 1 nued) , 



•Respondents 'ercent 
547. 20.9 
450. 1-7.^ 
296. 11.3 
1327. 50.5 
2620. 100.0 



Respondents =>ercent 
706., 25. 3 
370. 13.9 
251. • 9.4 
.1340. 50.2 
J667. leo.o 



Respondents Percent 
537, 23.5 
409i 15.3 
207. 7.3 
1412. 53.0 
2665. 100.0 

Respondents Percent 
^550. ' 20.3 
441. 16.5 
253. .9.5 
,1406. 53.1 
'265Q. 100.0 

Respondents Percent 

/ 630. - 23.2 
446. 16.5 
29D. 10.7 
1345i 49.5 
^711. ICO.O 



4 
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Table 2-45* . (Icon t Inued) 



Package t\o» II 
OOC tst-lmate 

1 523353. 

2 , ■ 5 772 5^^ 

3 ' " 34^*4:^. 

4 1Z?0927. 
Tatalf. 3165933. 



Ail packages 
OCC Estimate 
' 1 582515. 
2. ^600148. • 
3 4£6957. 
*. 4 16898*7^ 
Xotat; 3339567. 



C7 



Percent 
16.5 
18.2 
1C.9 , 
54^4 ■ 
100. a 



Perc ent 
17.4 , 
18.0 
14.0 

- 50.6 
109.0 



V 



ResDonifents Percent 
36C. ' 21.4 
4 01. ' 15.3 
240. . 9.1 
1419. 54.2 
. 262D. laO.G 



Respondents 'ercent/ 
5403. 22^ 
.4953. ITvO 
3004. 10.3 
14743. 5C.7 
29103 .. 1 00.0 



■ ■ \ 



s 



/ 
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Table 2-46* 



Distribution of year il 9-year-old sample 
schools^by DOC* TOC» anc STOC codes 



DCC 



TCC 



STOC 



Code 

1 
2 
3 
4 
5 

7 

^ Total 



No. ^ 


Pet. 

• 


No. 


Pet. 


NO;:^ 


Fet. 


119 


. 21.2 » 


80 • 


14.3 


80 


14.3 


82 


1<>.£) 


52 


9.3 


52 


9.3 


63 


;i.2 


50 


8.9 


50 


8.9 


297 


53^0 


379 


' 67.5 


52 


.9.2 


X 


X 


X 




47 


^8.4 


' X 


X 


X 


X 


-63 


11.2 


X 


X 


X 


X 


^ 217 


38.7 


561 


100.0 


561 


100.0 


561 


100.0 



/ 
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Table 2-47-. Weighted percentages of 9-year-olds 
by STOC and' DOC 



Year 11 



DOC 



DOC 



1 



STOC 



1 0.0 5.3 

2 • ' 0.0- 0.8 

3 0.0 0.0 

4 0.0 
Total 9.6 6.1 



4.1 

0.0 

Q.O 
10.4 



,8^0 
•0.0 
0.0 
0.0 
8.^ 



0.0 

io7^ 

0.0 
0.0 
10.9 



0.0 
0.0 

14.0 
0.0 

14.0 



0.0 
0.0 
0.0 
41.0 
41.0 



Year 10 



STOC 



7. 



■ 1 0.0 ' 6.8 3.6 

2 > 0.0 1.8 6.5 

3 0.0. .0.0 0.0 

4 • 8^7 0^ 0^ 
Total • 8.7 8.6 10.1 



13.1 
0.0 
0.0 
0.0 

13.1 



0.0 

10.5 
0.0 
0.0 

10.5 



0.0 

0.0 
11.8 

0.0 
11.8 



0.0 
0.0 
0.0 

37.2 
37.2 



Total 



17.4 
18.0 
14.0 
50.6 
100.0 



Total 



23.5 
18.8 
11.8 
45.9 
100.0 



ERIC 



Jr5? 



2-6.6.2 Age Class 2, 13-Yeai'-01ds . Table 2-48 presents Year 10 and 11 
weighted and unweighted percentages of Age Class 2 eligibles by STOC for 
alL packages. . As in Age Class 1, there have been decreases in STOC 4 
percentages and increases, an those for 'STOC 6 and 7. In this case there 
has also been a decrease for STOC 5. Weighted and unweighted percentages 
by package are presented in table 2-49. Percentages •^or each of the four 
NAEP regions are shown in table 2-60. 

Table 2-50 presents Year 10 and -11 weighted and unweighted percentages 
of Age Class 2 eligibles by DOC for :all packages. Changes from Year 10 
again reflect the change in primary sample, makeup; DOC 1 and 2 sljiow 
decreases from Year 10 to 11 and DOC -3 and 4 show 'incre|;5es . 

4 

Table 2-51 lists Year 11* weighted and unweighted percentages by DOC 
and package. Table 2-52 present,s Year 11 number of Age Class 2 simple 
schools by DOC, TOC; and STOC. Table 2-53 shows comparisons of Year 09 and 

10 Age Class 2 weighted percentages of respondents by STOC and DOC using 
^^chool weights. Again the major part of STOC 2 for each year was obtained 

from DOC 1. • 

2-6-6-3 Age Cla»s^3. 17-Year-0ld8 . Table 2-54 provides Year 10 and 

11 conp»risons for weighted and unweighted percentages of Age Class 3 

eligibles by STOC for- all packages. As with 9- and l3-year-old8/ decreases 

occurred in percentages for STQC 4 s^d increases fot STOC 6 and 7. The 

change is again, due to the random allocation of the sample for Year 10. 

Table 2-55 gives Year 11 weighted and unweighted percentages by STOC for 

eath of the Age Clasa 3 packages^ Percentages for all packages by STOC for 

ft 

each region will be found in table*2-64. 

Table 2-56 presents "comparisons of Year 10 and 11 weighted* and 
uoweighted percentages of Age Class 3 eligibles by' DOC for all packages. 
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Table 2-48. Weithted and unweighted percentages of 
13-4ea/-olds inYear^ll by STOC for all 
I — packages. 



All packages 



• 


Year 


11 


Year 10 


* 

Year 11 


^ — ^ 

, Year 10 


STOC 


Unweighted 
sum 


IJnweighted 
percent 


Unweighted 
percent 


Weighted Weighted 
sum percent 


A 

^eighted 
percent 



1 


4,116 


9.9 


10 


.0 


314,872 


9.5 


a 9.0 


2 . 


4,164 


10. Q 


10 


.1 


275,751 


8.3 


8.2 
10.6 


3 


4,103 


9.9 


9 


.9 


308,324 


9.3 


4 


2,894 




15 


.8 


194,737 


5.8 


14.5 


5 


4,758 


11.4 


13 


3 


402,613 


12.1 


13.6 


6 


7,084 


17.0 


10. 


3 


dkk^^ — - 




11 :^ 


7 




34.8 


30. 


6 _ 


__-ljl86,246 


35.6 


32.5 


Total 


41,574' 


100:0 ^^gg^ 


'***100. 


0-". 


3,327,443 


100.0 


100.0 



< 



I w 
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TabLe 2-49, 



Distribution of year 11 13-year-oLd 
estimated popuLatiorr and sample 
}^espondents by STOc and package 



Package 


no*- r ' 




Respondents 




O T A ^ 

STOC 


L St inate 


Percent 


Percent 


1 


395868 • 


11.7 


. 310. 


11.1 




399339 . 


11.8 


335. 


12. G 


3 


30IZ00. 


8.9 


288. 


.10.3 


4 


201377. 


5.9 


175. 


6.3 


5 


381314. 


11.2 


288. 


10.4 


6 


641546. 


18 .9 


449. 


16.1 


7 


1 069758. 


31.6 


941. 


■' 33.8 


Total 


3390402. 


100 .0 


2786. 


100. 3 


Package 


no. 2 






STOC 


Estimate 


Pe rcent 


Respondent s 


Percent 


1 


302746. 


8.7 


220. 


7.9 




319242. 


9.2 


326. 


11.7 


3 X 248235. 


.7.2 


. < .216. 


■ 7.8 


4 


229326. 


6.6 


198. 


7.1 


5 

* 


4 3816*9. 


12.7 


299. 


1-0.7 


6 


5323 77. 


15.4 


415." 


14.9 


7 «139132S, 


40 .2 


1111. 


39.9 


Total 


3461420. 


100 .0 


2785. 


100.0 


Package 


no. 3 









STOC Estimate 
216453. 
227835. 
376803. 
'J^.. 150006. 



gc 379 7.57. 



6 

7 

Total 

Package 

STOC 
1 

2. 
■ 3 
4 
5 
6 
7 

Total 





^Respondents Per6>jent 



217. 

293. 

316. 

17-9. 

251. 
^537. 
S973. 
2766. 



7.8 
10»^ 
11.4 
6.5 
9.1 
19.4 
35.2 

100. a 



nate 
315412. 
245326* 
337501. 
' 238781. 
354801. 
593113. 
1 175561. 
3260495. 



Perc ent 
9.7 
7,. 5 
10".3 
7.3 
10.9 
18.2 . 
36.1 
•1 0.0 . 0 



R%.spondents Percent 



263. 
243. 
33 2. 
223. 
279. 
432. 
98 7. 
2759." 



9.5 
8.8 
12.0 
8.1 
10.1 
15.7 
2^5.8 
IOC. 0 
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TabL^ 2-49 • 



Packag^ no. 5 



■STOQ 


Esti*iate 




1 


290375. 


8 -9 


2 


330127. 


IQ • 1 


3 


314545. 


^ - A 

7 • O 


• 4 


88367. 


7 ml 


5 


420437. 




6 


6921^^2. 


21.1 


7 


1138804. 


. 34.8 


Total 


3274847. 


1 00 .0 


Package no . 6 ^ 




ST6C 


E St Imate 


P# r c 0 n 


1 


• 212-821. 




2 


224956. 


7 _ 1 


i'^ 3 0 6812» 




4 


137398. 


4.3 


5 


376960. 


11.8 




651887. 


20.5 


7 


81270883. 


40.0 


Total 


3181717. 


lOC.O 


Package Ho. 7 




STOC 


Estimate 


percent 


1 


349549. 


10.5 


,2 


192259. 


5.8 


3 


325947. 


9.8 


4 


^^249158. 


' 7.5 


5 


'\ 389195. 


11.6 



^. 622329. 18.6 
. f 1207273. 36.2 
Total 3335710. . 100.0 



Package no. 8 



STOC 


Estimate 


Percent 


1 


341675. 


U.2 


2 


276112. 


9.0 


3 


220035. 


7.2 


\ 4 


179303. 


• 5.9 


% 5 


376373. 


12.3 


6 


564426. 


18.4 


7 


1102984. 


^6.0 


Total ■ 

* 


3060908. 


100.0 


* 


N. 


1 D J 



(cont inued) 



Respondent? Percent 



T n 4 


1 1 - P 
X A . £ 


O U 1 • 


11-1 


^ *t £ • 




1 1 • 




T t fl 
0 0 o « 




480. 


17.7 


932. 


34.4" 


2712. 


100.0 


Respondents 


Percent 


161. 


' 5.8 


. 226. 


8.2 


J iOO. 


19^.9 


/ 171.- 


6.2 


/ 323. 


11.7 




17.7 


^ 1091. 


39.5 


2760. 


100.0 



Respondent s Pe rcent 



316. 


11.6 


249. 


9.1 


233. 


8.5 


229. 


8.4 


339. 


12.4 


425. 


15.5 


943. 


34.5 


2734. 


» 100.0 


Respondents. 


Percent 


334. 


12.3 


266.. 


9.8 


241. 


8.9 


213. 


7.8 


287. 


10.5 


431. 


15.9 


947. 


34.8 


2719. 


100.0 



s 
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[ 

r 





Table 




{continued) 




Packaoe 


no 9^ 








STCC 


Estimate 


Pe rc en t 


Resnondent s 


P e r c en t 


I 


3463i5* 


1C.3 


299* 


10.5 


2 


258705# 


7.7 


306. 


10*7 


3 


374987# 


11 •! 


310* 


lb» 8 


4 


21,7222 • 


6 .4 


196» 


6«9 


5 


332126» 


9 .8 


307# 


10«7 


6 


626769 • 


18 #5 


497» 


17# 4 


7 


1 224692 • 


36 mi 


942» 


33« 0 


Total 


3380816. 


1 00 i-O 


2857# 


1 0^ • 0 


Package 


no • 10 








STOC 


Estlnate 


f^e rc ent 


Respondents 


Pe r cent 


1 


299065* 


8.7 


234. 


8.5 


2 


158072* 


4.6 


^ 174. 


6.4 


3 


235336# 




205« 


7#5 


4 


195521 • 


5 •? 


194^* 


?• 1 


5 


561923» 


16 94 


45 0 • 


16 • 5 


6 


597715# 


17»5 


436« 


16. 0 


7 ' 


1377415. 


40^2 


1.038# 


38* 0 


Total 


3425047# 


100*0 


2731« 


100*0 


Package 


no. ^11 








STOC 


r stima te 


Pe rc en t 


Rc st3ondent s 


Pe r cen t 


' 1 


307815. 


8.9 


257. 


9.4 


, 2 


307148. 


8.9 


270. 


9.8 


3 


324^52. 


9.4 


292. 


io» 7 


4 


200021. 


5.8 


185. 


6.7 


5 


414883. 


12 .0 


340« 


12.4 




622560. 


18.0 


432« 


15.8 


7 


1275327. 


37.0 ■ 


966« 


35.2 


Total 


3452206.. lOO.C 


2742# 


too • 0 


Package 


no . 12* 








STOC 


Estimate 


Percent 


Re spondent s 


Pe r cen t 


1 


271160. 




233» 


8.5 


2 


279600. 




305. 


11.1 


3 


279584. 




21 0. 


7.6 


4 


149243. 


4.5 


144. 


5.2 


5 


534672. . 


16.0 


407. 


14.8 


6 


690373. 


20.6 


^517. 


18.8 


7 


1J37378. 


34.0. 


^33. 


34. 0 


Tatal 


3342010. 


100.0 


2X9. 


100. C 



0^ 



erJc 
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Tabie 2-A9. (continued^ 



Package no. 13 

STOC Estimate Percent 

1 332086. 9.9 

2 308i91. 9.2 

3 353083. 10.5 

4 253768. 7.5 

5 3'»8381. 

6 67267'». 20.0 

7 1099^92. 32.6 
Total 3367875. 100.0 



Respondents Percent 



Package no. 1* 

STOC Estimate Percent 

377762. 11«2 

30'»366. 9.0 

1525630. 9.6 

220235. 6.5 

-335759. 10.0 
69352'*. 20.6 

w 

7 



1 
2 
3 

5 

*— 1115^^8. 33.1 



Total 327272'». lOCO 

Package ,no. 15 

STOC Estimate Percent 

1 3639-75. 10.8 

2 30AT91. 9.1 

3 300702. 9.0 
'^ 211329. 6.3 

5 39^1^8. ll«o 

6 76*»517. 22.8 

7 1012518. 30.2 
Total 3352280. 100. 8 

All packages 

I STOC Estimate Percent 

^ "l 31'»872. 9.5 

2 275751. 8.3 

3 30832^. 9.3 

4 19^727.' 5.8 

5 402613. 12.1 

6 641900. 19.^ 

7 11862'»6. 35.6 
^ Total 3327'»'»3. 100.0 



334, 
261. 
339. 
2'»2. 
262< 
481. 
867, 
2786, 



12. 0 
9.3 
12.2 
8.7 
9.4 
17.3 
31.1' 
100. 0 



Respondents Percent 
319. 11.5 
311. 11«2 
303. 10.9 
186. 6.7 
282. - 10.2 
U 488. 17.6 
883. 31.9 
2772. 100.0 

Respondents Percent 

315. 10.8 

298. 10.2 

276. 9.5 

244. 8. A 

30*. 10.5 

576. 19.7 

901. 30.9 

2916. 100.0 

Respondents Percent 

4116. 9.9 

4164. 10.0 

4103. 9.9 

2894. 7.0 

4758. ll*** 

7084. 17.0 

14455.^ 34.8 

41574. rOO.O 



# 




Table ^ 2-50, Weighted and unweighted percentages of 
13-yeax-olds in Year 11 b;^ DOC for all 
packages. . ^ 









All packages 
• 






- 




Year 


11 


Year 10 


Year 

* 


11 


, Year 10 




Unweighted 


Unweighted 


Unweighted 


Weighted* 


Weighted 


Weighted 


DOC 


SUffl 


percent 


percent 


sum 


percent 


percent 


1 " 


7,645 


is; 4 


28.0 


511,133 


15.4 


24.2 


2 


8,274 


19.9 


21.1' • 


670 ,.292 


20. 1 


22.7 


3 


7,084 


17.0 


10.4 


644,900 


19.4 


11.6 


4 


18,571 


44.7 


AO. 5 


1,501,H8 


45.1 


41.5- 



Total 41,57A 100.0 ' 100.0 3,327,443 100.0 100.0 
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Table 2-51. Distribution ol year 11 13-year-old 
estimated population and sample 
respondents Dy DOC and package 



Package po. 1 

DOC Eitimate Percent 



1 
2 
3 

Total 



603192. 

6&0038. 

641546. 
1465626. 
3390402. 



17.8 
20.1 
18.9 
43.2 
100.0 



Respondents Percent 
- 565. ^2C.3 
521. ia.7 

449. 16.1 
1251. 44.9 
2786. "100.0 



Package no. 2 

DOC Estimate Percent 

1 619095. 17.9 

2 615877. 17.8 

3 53^77. 15.4 
,4 1699171. 48.9 

Total 3461420. lOQ.O 



Respondents Percent 
558. 20.0 
481. 17.3 
■ 4,15. 14.9 
1331.- 47.8 
2785. 100.0 



Package 


no. .3 




Respondent s 


. DOC 


E^s 1 4 m a t e 


Perc 9nt 


1 


430d96. 


13.2 


509. 


2 


704304. 


21.6 


530. 


3 


,707498. 


21.8 


537. 


4 


1411287. 


43.4 


1190. 


T^tal 


32531654 


100.0 


2766. 



18.4 
19. 2 
19.4 
43. 0 



ii»ackage no. 4 

DOC Estimate Pepfcent 

1 ' 464901. 14.3 

2 711508. 21.8 

3 " 593112- 18.2 

4 1490974. 45.7 
Total 3260495. 100.0 

Packag.e no. 5 

DCC Estimate Percent 

1 380723. 11.6 

2 772753. 23.6 

3 692192. 21.1 
4^ 1429179. 43.7 

Total 3274847. 100.0 



Respondents Percent 
470. 17.0 
607. 22.0 
432.- 15.7 
1250. 45.3 
2159. 100.0 



Respondents Percent 

A A "J 1 /. K 



447, 
' 549. 

480. 
1236, 
2712. 



16.5 
20.2 
17.7 
45.6 
lOO.O 



\ 

\ 

\ 
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*7able 2-51* (continued) 



Package no* . 6 

DOC Estimate Pe^-cent 

1 412014. 13.0 

2- 634112. , .19.9 

3 651887.- 20.5 

4 1483704. 46.6 
Total 3181717. 100. 0 



Package no. 7 

DOC Estimate Percent 

1 526603. 15.8 

2 6.29956. 18.9 

3 622329. • 18.6 

4 1556822. 46.7 
Tot^l 3335710. 100.0 



Respondents Percent 
442. .16.0 
578. 20.9 
488. 17.7 
1252. 45.4' 
276 0./ 1-0 0.0 



Respondents Percent 
505.- 18*5 
545. 19.9 
425. 15.5 
1259. 46.1" 
2734. 100.0 



Package no. .8 



DOC 


Estimate 


Percent 


1 


4836-92. 


15.8 


2 


568130. 


18.6 


3 


564426. 


18.4. 


4 


1444660. 


47.2 


Total 


30609C8. 


100. 0 


Package 


' no . 9 




DOC 


Estimate 


Percent 


. 1 


592776. 


17.5 




59 0264. 


17.5 


3 


•6V6769. 


18.5 


4 


1371007. 


46.5 


Total 


33808 16. 


100*0 


Package r^o. 10 




DOC 


Estimate 


Percent 


1 


382 11 6-. 


■ 11.2 


2 


7^8736. 


22.4 


3 


597716. 


" 17.5 


4 


16764 7^9. 


48.9 


Total 


3425047. 


100.0 



Respondents Percent 
535. 19.7 
•472. 17.3 
431. 15.9 
1281. 47.1 
2719** 100.0 



Respondents Percent, 
557. 19.5 
562. 19.7 
497. ■ 17.4 
12^1. 43.4 
^2€57. 10 0.0 



Respondents Percent 
384. 14.1 
639. 23^4 
436. 15.9' 
1272. 46.6 
2731. 100.0 



ERIC 



ICO 



Table 2-51.' (continued) 



\ 



Package no. 11 

DOC Estimate Percen-t 



1 
2 
3 
A 

Total 



468722. 

777782. 

6225&0. 
1583142. 
3452206. 



13.6 
22.5 
18.0 
45.9 
100.0 



Respondents Percent 



475. 

612. 

432. 
1223. 
274.2. 



17.3 
22.3 
15.8 
44.6 

100. 0- 



Package no. 12 

-DOC Estimate Percent 



- 1 
2 
3 
4 

Total 



431929. 

811170. 
" 650373. 
1408538. 
3342010. 



12.5 
24.3 
20.7 
42.1 
100.0 



Respondents Perce-nt 
429. 15.6 
637. 23.2 
^517. 18.8 
1166. 42.4^ 
2749. 100.0 



Package no. 13 

DCC Estimate Percent 




649999. 

613625. 

672674. 
1431577. 
3367875. 



19.3 
18.2 
20.0 
42.5 
100.0 



Respondents Percent 
587. 21.; 
517. 18.5 
481. 17.3 
1201. 43.1 
2786. 100.0 



Package no. 14 



DOC 
1 
2 
3 
4 

Total 



E stimate 
637899. 
548091. 
693524. 

1493210. 

3372724 . 



Pe f c eht 
18.9 

. 16.2 
2.0 .6 
44.3 
1 00 .0 



Respondents Percent 
" 599. J1.6 
4 8 3.^*<i^7.4 
488. .17.6 
^ 1202. 43.4 

fr ^2772. 100.0 



Package no* 15 



DOC 
■ 1 
2 
3 
4 

Total 



E st Imate 
583237. 
628033. 
764517. 

1376493. 

3352280. 



Pereent. 
17.4 
18.7 
22.8 
41.1 
100.0 



Respondents Percent 



^83. 

541. 

576. 
1216. 
2916. 



20. 0 
18.5 
19.8 
41.7 
100.0 
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Table 2-bl •• (continued) 



All packages 

DOC Estimate Percent 

1 . 51kl33. • ,15.4 

2 ' 670292. 20.1 

3 644900. 19.4 

4 1501118. ■ 45.1 
Total 3327443. 100.0 



Respondent's Percent 
7645. 18.4 
'8274. 19.9 
7084. 17.0 
18571. 44.7 
41574. 100.0 



ICC 
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Tab.le 2-52 1 D1str1but1orv2»dt year 11 .13-year-old sample 
schools by OOt^ TOCf STOC codes 



/ 



I. ■ 



A 









Code 


Ko. 


Pet. 


1 


120' 


22.3 


2 


' 81 


15.1 


3 


7^ 


13^8 


4 


2^2 


<»8r% 


. 5 


X 


X 


6 


X 


X 


* 7 


X 


. X 


Total 


537 


100.0 









-ERIC 



70C 


















No. 




* Pcti 




Pet. 


86 




16.0 




16.0 


59 




11.0 - 


59 


11.0 


53 




9.9 


53 


^.8 


339 




63.1 


44 


8.2 


X 




X 


45 


B.4 


X 




X 


74 


13.8 


.X 


" X 


' 17«f 


32.8 


537 




100.0 


537 


100.0 
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■^-Tatrtre 'r-"S37" -Weighted -pereeata^es -ia-year-_Qlds_ 
by STOC and DOC 



Year ir 



DOC 








STOC 




4 




1 


2 - 


3 


4 ^- .5 


6 . 


7 


Total 


1 


0.0 


6.3 


3-4 


5.9 ' 0.0 


0.0 


• 

0.0 


15.6 


2 




2.1 


5.7 


, 0.0 12.0 


0.0* 


0.0 


19.8 


^3 


0.0 


0.0 


0.0 


o.a 0.0 


19.4 


0.0 


19.4 


A 




u . u 


u . u 


h n 0 0 


0.0 


35.7 


45.2 


Total . 


9.5 


8.4 


9.1 


5.9 12.0 


19.4 


35 '.7 


100.0 


* 


- 


1— 




Year 10 

« * 


■ 


• 




DOC 








STOC 


• 






1 


2 


3 


■ 4 5 

« 


6 


,7 


Total 


1 


0.0 


•5.8 


3.9 


14.4 0.0 


0.0 


0.0 


24.1 


2 


0.0 


2.3 


6.8 


0.0 13.7 


^ 0.0 


0.0 


22.8 


y 3 




0.0 - 


0.0 


0.0 0.0 


11.6 


0.0 • 


11.6 


* 4 
Total- 


8.9 
8.9 


O'.O - 
8.1 


Q.O 
10.7 


0.0 0.0 
14.4 13.7 


0.0 
p. 6 


32.6 
32.6 <f 


41.5 
100.0 



7 



Table 2-54. Weighted and unweighted percentages of 
17-year-olds in Year 11 by STOC for all 
packages. 









All .packages 










Year 


11 ^ 


Year 10 


Year 


11 


Year 10 




Unweighted 

SUiD 


Unweighted 

V* ^ A ^ ^ 

perceni. 


Unweighted 
percent. 


Weighted 

dim 


Weighted 


Weighted 


1 
* 


3 452 


9 6 


9 '5 


253 ,550 


7.9 


7.8 


• 2 


3,896 


10.8 


11.1 


279,427 , 


8.6 


10.7 


3 


3,641 


10.1 


10.0 


388,867' 


12.0 


9.5 


4 

• 


2,368 


6.5 


13.2 


141,350 


4.4 


11.0 


5 


3,686 


« 10.2 


13.^ 


396,121 


11.4 


16.3 


6 


6,730 


18.6 


10.1 


635,086 


19.6 


12.0 


7 


■ 12,33^6 • 


34.2' 


32.5 


1,167,197 


36^1 


32.7 



Total 36,109 100. 0 100.0 3,254,598 100.0 • 100.0 
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Tabte 2--35 • 



DIs Mbation of year n 17-year-.oLd 
estimated population and sample 
respondents by STOC and package 



Package 


e no. 1 


•- 




Estimate 


Perc ent 


1 


327816. 


IC. 1 


2 


19263S. 


S.S 


3 ■ 


454187. 


14.0 


* 


256978. 


7.9 


5 


307647. 


9.5 




619389« 


19.1 


7 


1C83125. 


33.4 


Total 


X O A i 7 7 o 

J it HI 7 7 8. 


ICC . 0 


Packarc 


s no. 




STOC 


Es timate 


PerceVit 


1 


227854. 


6.9 


2 


' 2G5422. 


6.3 


3 


563269. 


17.2 




. 1 11794. 


3.4 


• 5 


367763. 


11.2 


& 


, 622153; 


18.9 


7 


T 1829/59. 


36.1 


Total 


3279214.' 


100.0 


Pac k a ce 


no. 3 . 





STOC 
1 
2 
3 
4 
5 
6 
7 

Total 



Ultimate. 

3C9492. 

303804. 

554845. 

15Q770. 

277991. 

55in35. 
1225825. 
3373762. 



Percent 
9.2 
9.0 

5 
5 
2 

16.5 
36.3 
ICO.O 



116.! 



Package no. 4 
STOC Estimate 
248181. 



1 

2 
J 

4 
5 
6 
7 

Total 



310D91. 

31960C. 

123465. 

344889. 

560344. 
1245243. 
3151813. 



Percent 
7.9 
9.8 



3' 

11 , 
17. 
39. 
ICC. 



9 

a 

5 
0 



/ 



Respondents =»ercent 



309. 
216. 
231. 
278. 
252. 
473. 
825. 
2584. 



12.0 
8.4 
'3.9 
10.7 
9.8 
18.3 
31 .9 
I'WL,?^ 



Respondents 
220. 
221. 
287. 
156. 
253. 
448. 



Percent 
8.S 
8.7 
11.3 
6.1 
■' 10.0 
17.6 



960. 


37.7 


254-5. 


lOC.D 


Respondent s 


Percent 


279. 


■ 10.?, 


519. 


12.4 


298. 


11.5 


159. 


6.2 


202. 


• 7.8 


429. 


16.6 


»94. 


34.7 


258C. 


leo. 0 


Respondents Percent 


278. 


10.9 


305. 


12.0 


23 6. 


9.3 ■ 


156. 


S.I 


290. 


11.4 


420. 


16.5 


861. 


33. 8 


2546. 


ICO. 3 
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Table 2-55. (continued) 



Package no« 5 



STOC 


Estimate 


Percent A-Re spondent s 


cent 


1 


22C354. 


^7.0 ^ 


194. 


7.5 


2 


267830. 


8.5 


323. 


11. S 




268382. 


8.5 


\ 247. 


9.5 


A 


\ 97446, 


3.1 


139. 


5.3 


5 


\ 394267. 


12^5 


290. 


11.1 


6 


.652:01. 


2C.8 


499. 


19.1 


7 


1244803. 


39.6 


9^. 


35.9 


tal 


3145383. 


lOC.O 


2608. 


ICO. 0 



Package noi 



STOC 


Estimate 


P ere ent 


Respondents 


Percent 


1 


185708, 


6.1 


219, 


8.5 


2 


28098D. 


9.2. 


253. 


9.3 


3 


267254. 


S.8 


234. 


9. 0 


4 


207392. 


6.8 


239. 


- 9.2 


5 


3480.19. 


-11.4 


276. 


10.7 


6 


, 712375. 


23.4 


516. 


19.9 


7 


.1 C449C4. 


• 34.3 


851. 


32. 9 


Total 


3C46632. 


100.0 


2588. 


- 100.0 


Package no.' 7 










Estimate 


P e r c e nt 


Respondents 


Percent 


JTOC 


184282. 


- 5.5 


223. 


8.6 


2 


318 4 8.T. 


9.5 


^2. 


10.9 


3 


430066. 


] 12.9 


• 230. 


8.9 


4 


115986. 


/ 3.4 


134. 


5.2 


5 


.5D94S$^ 


15.3 


271. 


10.5 


6 


71P479. 


21.5 


• 57^. 


22.2 


7 


1 272964. 


32.1 


369. 


33. 7 


Total 


333970>>^ ICO. 6 


2579. 


100. 0 



STOC 


Estimate. Pe/cent 


R e-s p on d e n t s 


Percent 


1 


348781, . 


11.4 


-284. 


10.9 


2 


2CQ468. 


6.6 


236. 


■ 9.0 


3 


244691. 


8.0 


225. 


8. S 


4 


115377. 


3.8 


149. 


5.7 


a. 


ia4 i£B.- 


12.6 


319. 


12.2 


6 


755919. 


'24 .8 


602. 


23. 1 


7 


irD022?. 


32.8 


796. 


30.5 


Total 


3C49846* 


ICJ.O 


2611. 


1 rc. 3 
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Table 2-55 • (continued) 



Package no. 5 . 
STOC Estimate 
230395. 



1 
2 
3 
4' 
5 

7 

Total 



2>60799. 

H C2143. 

116829. 

276911. 

764391. 
1173680. 
3224852. 



Pe r c ent 
—^7.1 
8.1 
12.5 
3.6 
8.6 
23. 7 
36.4, 
ICO .0 



Respondents Percent ^ 



Package no. 



10 



STOC 


Esti mate 


P e r c e nt 


1 


232566. 


• 7.3 


o 


334795. 


1C.5 


3 


491208. 


15. .4 


4 


158964. 


5.C 


. 5 


324S43. 


IC .2 


• 6 


5C1C03. 


\ 15.7 


7 


1143?2r. 


35 .9 


Total 


318&196. 


IOC .C 



251. 
236. 
318. 
157. 
210. 
534. 
756. 
2502 . 



10. C 
9. 4 

1Z.7 
S.3 
8.4 

21.4 

31.8 
100.0 



d e n #s ' e 


r cent 


.194. 


7.7 


289. 


11.4 


280. 


11.1 , 


154-. 


6.1 


• -292, 


.11.6 


409. 


16. 2 


905.. 


35.9 


2523. 


ICO. 0 



Package no. 11 
STOC Lstluiate 
302919.^ 



1 
2 
3 
4 
5 
6 
7 

Total 



321393. 

338923. 
85C61. 

476348. 

629259. 
1336665. 
3490568. 



Pi^ck age no. • 12 



1 
2 
3 
4 

5 

6 
7 

Total 




179518. 

323518. 

3 36701. 

165192. 

37C284. 

586239. 
1296899. 
3258351. 



Percent 


Respondents Percent 


5.5 


216. 


8.3 


9.9 


3S1. 


13,9 


1C.3 


267. 


10.3 


5.1 


188. 


. 7.3 


11.4 


^ 195." 


7.5 


. 18.0 


384. 


1^.8 


39.8 


984. 


,37.9 


IOC? 


2595. 


-ICO. 3 
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V Table 2-55 • (continued) 



Package no. 13 
'STOC Estimate 
32544C. 



1 
2 
3 

5 
b 
7 

Total 



3C86S1. 

252631. 

1<>6409. 

3155^6. 

5598C5. 
116C592. 
3069084. 



Package no. 1* 
STOC Istlfflate 
226691. 



1 

2 
3 

5 
6 
7 

Total 



283089. 

52C2'»'>. 

129235. 

469560. 
J 668814. 
1 129854. 
3427487. 



Percent 
10.6 
IC.l 
8.2 
4.8 
10.3 
18.2 
37^8 
100.0 

Percey 

8.2 
15.2 

3.? 
13.7 
19.5 
33.3 
ICC.O 



Respondents Percent 



320. 
509. 
231. 
195. 
245. 
429. 
9C8. 
2537. 



12.1 
11.7 
8.8 
7.4 
9.3 
16.3 
34.4 
100.0 



Respondents Percent 



224. 
2S0. 
287. 
153. 
3r-4. 
537. 
868. 
2633. 



S.3 
9.9 
10.9 
5.3 
11.5 
20.4 
33.0 
100. Q. 



All packages 
STOC Estimate 



Percent 



1 


253550. • 


7.9 


2 


279427. 


8.6 


3 


388B6 7. 


12-. 0 


4 


14135C.. 


4.4 


5 


369121. , 


11.4 \ 


6 


635086. 


7 


116719,7. 


36.1 


Total 


3234598. 


10 0.0 



Respondent s 
3452. 



3896. 

3641. ^ 

2368. # 

3685. 

6730. 
12336. 
36109. 



Percent 
9.5 
10.8 
10. I 
6.3 
10.2 
18.5 
34.2 
100. 0 
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Table 2^56. Weighted and unweighted percentages of 
17-year-olds in Year 11 by DOC for all 
packages. 






Year 


11 


Year 10 ~ 


Year 


11 


Year 10 


DOC 


li 

Unweighted , 

SUB 


Unweighted 
percent 


Unweighted 
V percent 


Weighted 
sum 

* 


Weighted 
percent 


Weighted 
percent 


1 


7,517 


20.8 


26.6 


503,260 


15.6 


21.5 


Z 


6 074 


16.8 


21.3 


675,505". 


20.9 


26.1 


3 


6,730 


18.7 


10.1 


635,086 


19.6 


12.0 


4 


15,788 


43.7 


42.0 


1,420,747 


43.9 


40.4 


Total 


36,109 


100.0 


100.0 - 


3,234,598 


100.0 


100.0 


* 




• 




• 








ft 

• 

% 






• 




f 



ERIC 



170 



DOC 1 and 2 showec* decreases, while DOC 3 and 4 experienced increases as 
results of the change in sample allocation procedure. Table 2-57 lists 
Tear 11 weighted and unweighted .percentages by DOC and package. Table 2758 
presents percentages of Year 11 Age Class 3 sample schools by D.OC, TOC, and 

STOC. * ' t 

Table 2-59 shows Year 10 and 11 weighted percentages of Age Class 3 
eliiibles by STOC and DOC. As in e|ch Of the other two age classes, the 
kjor part qf STOC 2 has come from DOC 1 and the remainder from DOC 2, with 
the converse true for STOC 3. - . 

As already indicated, table 2-60 presents Year 11 weighted and 
unweighted percentage of Age Class 1, 2, and 3 eligibles by STOC. for ali 
packages in each region. ~* ^ 



V 



171 
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. '7 57 Distribution o^ year 11 ^l7{year-old 
Table 2-57. f/^^,^, population -d sj.p e 
respondents by DOC and pacl^age 



Package no. 



ooc 
1 

.2 

Total 



Estimate 
58A3A5. 
6271G3. 
619389. 
14109^1. 
32'*1778. 



Percent 
^8.0 
19. 

19.1 
til. 5 
100.0 



Pack age " no. 



DOC 
1 , 

*2 
3 
A 

T otal 



£st1aa te 
440882. 

807367- 
620153. 

1410812. 

327921'»» 



Perc e nt 
13-5 
24 .6 
18.9 
43.0^ 

loo.o' 



Respondents Percent 



61C. 
367. 
.473. 
113A. 
2584. 



23. & 

18.3 
43.9 
1 00. 0 



Respondents Percent 
47A. 18.6 
44?. 17 
448. 17. & 
1180. r^i"* 
2545. 100.0 



Package-no. 3 
DOC Estimate 

1 - 47C368. 

2 8173A2. 

3 551C35. 

4 1535317. 
Total 3373762. 



Perc ent 
13.9" 
24 .2 
16. A 
4/#.5 
100 .C 



Respondents oercent 
506. 19«& 
472. 18-3 
429. 1&»^ 
1173. *5.5 
2580. ICO.O 



4 



Package no 



ooc 
1 

2 
3 
4 

Total 



Estimate 
57398ff . 
524C65. 
560344. 
1 4 9|a 2 4 . 
31S1813. 



p er c ent 
18.2 
16.6 
17.8 
47.4 

icc.c 



Respondents 'ercent 
575. 22.6 
412. IS. 2 
420. 1£'»5 
1139. 44.7 
25^6. • 100.0 



Package no. 5 

0OC Estimate Percent 

1 460056. 14.6 

2 • 567869. 18.1 
? 6520C1. . 2C.7 
4 14651S7. 46.6 

Total 2»l'450B3. .100.0 



spon 



idjK^ts Percent 




ERJC 



1 



4 
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Table 2-57 



C con t i nued) 



Pack-age no. 6 
DOC Estinate 



1 
2 
3 

Total 



5f>C57r.. 

543075. 

712375. 
123C612. 
3C4S&32. 



Perc ent 
18.4 
17.8 
23.4 
40.4 
ICO.O 



Respondents Percent 



582. 

426. 

516. 
1570. 
2588. 



22.5 
16.2 
15.5 
41.4 
ICO.O 



Package no< 



DOC 
I 

3 
4 

Total 



Estimate 
459056. 
912919. 
710479. 

12572.46. 

33397CC. 
* 



Perc ent 
13.7 
27.3 
21.3 
37.7 
ICC. 0 



Respondents' =*ercent 



466. 

451. 

573. 
1089. 
2579. 



IS.l 
17.5 
22.2 
42.2 
ICO. 0 



Pack aget no. 8 
DOC Estimate 

1 4 09298.^ 

2 S35626.' 

3 755919. 

4 1349:03. 
Total ' 3C49846. 



Package no. 9 
DOC Estimate 

1 . 511338. 

2 545344. 

3 764391. 

4 1403779. 
Total 3224352. 




Respondents ,=*eTc6nt 
491. 18.8 
438. 16.3 
6C2. 23.3 
108C. 41.4 
2611. ICO.O 



Respondents Percent 
537. 21.5 
' 384. 15.3 
534. 21.3 
1047. .41.5 
2502. icO.2 



Pack age no. 1 0 . 
DOC Estimate 

1 5C2659. 

2 8C6948. 

3 5 01204. 

4 l3TfTB5. 
Total 3166196. 



Percent Respondents Percent 

15.8 - 5C1. 19,B 

25.3 514. 20.4 

15.7 409. 16.2 

43.2 1099. 43.6 

103. C 2523. ICO.O 



t -7 , 
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Table 2-57 • (continued) 



Package no. ' 1 1 

DOC Estimate Percent 

1 12.2 

2 755566. 22.8 

3 i29259. 18.0 

4 l4fi9585. 47.0 
Total 34^0568. ICD.C 



Respondents Percent 




Package 


no. 12 


i. 


Respondents 




DOC 


Estimate 


P ere ent 


Percent 


1 


624554. 


19.2 


664. 


•25. S 


2 


571141, 


17.5 


34 7. 


13. 


3 


586239. 


18.0 


384. 


14.3 


,4 


1^76417. 


45.3 


^ 1200. 


46.2 


Tqtal 


3258351. 


100. n 


..^ 2595. 


IGO. 0 


Package 


no. 13 




<* 


P e r c^ n t 


DCC 


Estimate 


Percent 


Respondents 




1 


51663C. 


16.8 


569. 


. 21.6 


2 


5C6618. 


16.5 


411. 


15.6 


3 


559804. 


18.3 


^29. 


IS. 2 


4 


1486032. 


.48.4 


1228. 


46.6 


Total 


3069084. 


100. G 


2637. 


100.3 


Pack age 


no. 14 








DOC 


Estimate 


Percent 


Respondents 


Percent 



1 

2 



5^6047. 
896C81. 



14,8 
26.1 



511 
^93 



9.^ 
18.7 



3 


6&8814. 


13, 5{ 


537. 


26.4 


4 


1356545. 


. 39.6 


1 092. 


• 41.3 


Total 


3427487. 


lOC.O 

\ 


2633. 


100.0 


All packages 




\ . 




DOC 


Estimate 


Piercent 


Respondents 


Percent 


1 


5 03260.' 


15.6 


7517. 


20.8 


2 . 


6755C5. 


2C.9 


607^. 


16.3 


3 


6 35 086. 


.19.6 


6730. 


18.7 


• 4 


1420747. 


43.9 ^ 


15788. 


43.7 


Total 


323459€. 


lOG^C 


36109. 


1C3.3 



er|c 



17 ■! 
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Table 2-5^^ Distribution of year 11 17-year-old sample 
schools by DOCt TOCt anc STOC codes 





1 


k 








Dec 




TCC 




Code 


No. 


Pet. 


No. 


Pet. 


1 


102 


23.5" 


7C 


16.1 


2 


68 


15.6 


63 


14.5 


3 


53 




38 . 


8.7 




212 


48.7 


2^A 


6 0.7 


5 


X 


X 


X 


X 


6 


X ^ 


X 


X 


X 


7 


X 


X 


X 


X 


Total 


435 


100.0 


435 


ipc.c 



STOC 



No. 


Pet. 


70 


16.1 


63 


14.5 


38 


8.7 


31 


7.1 


38 . 


8.7 


53 


12.2 


142 


32.7 


435 


100.0 



* 



TabU;2-60. Distribution^tYear.U est^ ^ ^ 



^ Rc|ion/STOC 



r^nMi ^d p opulation, 
5 



Total 



Horthv't • , No 
Pet 



Pet 



No. 



Southeast 
Central 
West 
Total 

Northeast 

Southe*s^ 

Central 

Weft 

Total 



Northeast ' No. 

Pet. 

^ . 

Southeast No. 

. Pet. 



If. loq 49 367\ 65,052 106,7^6 



12.5 



,298 459,575 
:i 20.3 



1 2 6.6 5.1 

, RR< 96 072 10^1,13^1 115,307 

"Ti 'V.^? J '^-^ 

'"il" 



85,318 
8.9 



327,867 
43.7 

366,374 
46.6 

326,806 
38.4 

347,344 
36.5 



Total 

Q-Yeac-Ol<i» 

750,064 
100.0 

785,876 
100.0 

85-1,159 
100.0 

952,468 

ioo.c 



297 1,291 
4.3 18.7 



980 
14.4 

1,180 
14.6 



180 
^.6 

541 
6.7 



599 
8.6 

483 

7.1 

451 
5.6 



.6 

458 

6.7 

885 
11.0 



420 


616 


6.1 


8.9 


577 


1,126 


8.4 


16.5 


89 f 


698 


11.0 


8.6 


^983 


564 


T3.5 


7.7 



3.101 
44.8 

3,022 
44.3 

3,434- 
42.5 



31.1 



ri. ,5*1 V,'? 

,,.„ 2.m .^5'; 

10.0 aO.O 9.9 9.3 



6,917 
100 0 

6,826 
100.0 

8,080 
100.0 

7,280 
100.0 

29,103 
100.0 



No. 


321,457 


Pet. 




No. 


45,522 


Pet. 


5.6 


Ho. 


92,468 


Pet. 


11.4 


No. 


129(285 


Pet. 


15.2 


. No 


47,597 


" Pet. 




No., 


314,872 


Peu. 


< 9.5 



90,632 
11.3 

44,675 
5.5 



71,817 
8.9 

28,359 
3.5 



50,404 80,271 151,792 

6.3% 10.0 . 18.9 

79,990 174',229 

9.9 21.5 



3!, 930 
3.9 



t.'y^ 75 395-. 62,498 153,^25 
ir5,985 110,625 l5,J9b .^^ 



5.2 

96,459 
11.2 



13.0 

97.523 
11.3 



8.9 

37,008 179.^854. 165,550 
^ (,,3 20.8 



,313, "916 
39.0 

359,938 
. 44.3 

273 ,911 
323 

238 .481 . 
27.7 



n-tear*01<i« 

804,354 
100.0 



547 1,600 
5.3 15.5 



980 
9.5 



998 
9.6 



811.589,. 
^ 100.0 

0 

849,028 
100.0 

862.472 
100 .'0' 



i;096 
IK5 

l',87p 
16.1 



654 
6.9 



• 8Q.9 1 ,3^3 
4.C 11.9 



389 ^19 
4.1 

796 
6.8 



923 1,781 

8.9 17.2 

813 1,734 

8.6 18.2 



3,523 
34.0 

4,407 
46.3 



730 1.8-70^^.J^1 
6.3 16>1 35.8 



3o..;»^ ^■I'i -I- '"iK '■'"i"^ 

Q.S 8.3 9. Z ^ 



43,366 
. 8.8 



74,897 137,545. 
10. 5-* 19.2 



4«Atral 

West 
Total 



•No: 

Pet, 

No. 
P^t. 

No. 
Pet. 



27,682 '^^^ 

12.7 ^•^^X 3.8 ^ 

^ OS '175^990 

.2 



,3.0. ;70.». ns.s^o ...sj .s.;. -... 



3V. 528 

253.550 279.«7 388 M7 ^1.350 
8.6 t , . 



284,052 . 
p9.7 

348,177' 
-46.4 

315,9a<|a 

34. 

219,fl'74 
25.* 




603 1»101 1.35^ 
6.0 . 10.9 1'3.^ 



10.0 



681 2,292 . 1,6^3 
6.8, 22.7 16. « 



2,364 
23.4 



353 1,755 
,4.2 20.7 



749,594 
1QQ..0 

918.727 
100.0 

850, 509 > 
100.0 . 



253 
3.2 

896 
Bt5 



10.6 



.103 


2,894 


9.9 


7.0 


663 


462 


7.8 


. 5.5 

* 


50J 


461 


/6.5 


5t9 


805 


595 








1,666 


^ 850 


17.9 


9.1 



11.4 



17.5 34.8 



10,352 
100.0 

9,512 
100.0 ^ 

11,625 ^ 

' 1100.0 

10,085 
100.0 

41,574 
100.0 



^10 1,385 

9,6 16.4 

452 1,528 

5.8 19.5 



3.023 
35.8 

3,494 
44.6 



8,451. 
100. 



1,59^ 
15<2 

368 

v.". Vo'i -f'^ 



3., 11.4 19.4 32.1 

850 4,223 ^.783 >^50 
9.1 13.1 ^ 19.1 26,3 



7,827 
1^0.0 

100.0 

<l.352 
100.0 

36,109 
100.0 




1 
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2.7 Historical File 



-A historical computer Tile of •. districts and schools selected for 
National Assessment in Ye^rs- Oa" through 06 was created during operatiooal 
' Year 07. In Year 08, this file was updated to include districts and schools 
sela<;ted, for assessment in Years 07 and- 08.- Due tp budgetary constraints 
t^ historical file was not updated to include districts and schools select- 
ed foi- assessment in Year 09 or 10. Neither were STOC codes adde^^to the. 
file for schools selec^d for assessment-, in^ Years 04 through 08^. In Year 
.11, work was begun on updating the file for Years 9, 10, and 11, to be 
completed in Year 13. ' . ' 

2.8 Yeat 11 Efficiency Studies ,< 

- V -Work on Yea* 11 -Ef f iciencjL Studies ..was_ begun in late 1980, to be 

completed in 1981. 

2.9 Response Experience * 

The schools selected in Year 11 are classified in table 2-61 by region 
' . and age class. As noted, these figur^^» included schools which were selected 
for' participation in Year 11 after the initial secondary sample had been 
selected (i.e., new schools, samplfe schobls with grade range changes which. 
^ were added to the saj^le, and • replacement schools). A total of 1,740 
school. wa¥ selected for tbe Tear sainpler 608 for Age-Clas^l, 642 for 
Age Class 2<,.and 490 for Age C\?8s 3.. " « 

The schools whi^h were added to ^thc initial Year 11 secondai^ sampje 
are clasJlied by region and age class in table 2-^2-. Of the 54 schools 
■•■ ^ «d<re^', tliree were selected ai .'result of sample .updating <berations . The 
* updating operations consisted^of the following' activities : ' TD njw s^ls^> 
with eaigible^s in selected districts were given a Chance to ^nte^^ 
■ sample on a probability basis; (Z) sample schools which haJ un<^rgon6 grade 



'Table 2-61 


, Number of 


schools selected in Year 

\ 


11 sample-^ 


• 




• 












Region 1 


Region 2 


Region 3 


Region 4 


Total 


Age 1 


138 




191 


154' 

* 


608 


Age Class 2 


154 


145 


192 


151 


642 


Age Class 3 


• 107 . 


103 


145 • 


135 


490 


Total Year 11 Sample 


399 . 


373 


528 * 


440 


1,740 ■ 


Includes schools selected for participation 
secondary sample' had been' drawn. 


in Year 11 


after the 


initial 



Table 2-62. Number of schools added to initial Year 11 secondary %ample after 
initial iecoadary sample selection 



EegioxjL 1 Eegion 2„ . Region 3-.- - fiegioa '4 -- Total 



Age Class 1 4 
Age Class 2 
Age Class 3 
^otal'Year 11 Sample 



? 
6 




14 



1 
4 

• \ 

a 



0 

4 
2 
6 



13 

-4 . 
_9 
? 26 . 



16 
18 
20 

54' 



2/ 



2/ ' ' ■ ' 

- Three were selected as a result of sample updating operations. 



r 

r 



0 
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ra^&ge -ehasges- such that they noir bad eligibles for a previously imcQnsider- 
t^d age class were also given a ch^^c^ to enter the sacnple on a probability 
basis. The remaining 51 of the 54 additiona^l schools were selected as 
replacements for refusals* 

Table 2-67 sunanarizes the Year 11 school response experience by age 
class. For Age Class 1, 92.1 percent of the selected schools participated; 
83.2 percent of the selected schools participated at Age Class 2; and 84,1 
percent participated at Age Class 3. Across the entire sample, \ total of 
86.6 percent of the selected schools participated. Schools were classified 
] «s nonparticipants either because they Refused, were closed, had no eligible 

{ ' ^ - , , ^ 

respondents, or for other reasons. Classification of selected scbools by 

these nonparticipation categories is also incj.uded in table 2-63. 

Year 11 school cooperation is, summarized in table 2-64. Based 'on the 

originally selected schools, less those schools which were found to be 

• • closed or no longer have in- range grades, the Year 11 cooperation rate was 

92. § percent. 0^ 

Tables 2-65 a(nd 2-66 present summary data, by age class, on the number 

V 

* ♦ 

and percentages of sessions completed and students assessed during Year 11. 
Table 2-65 shows data^Joly for regular assignments, while table 2-66 presents 
sumary data only for standby assignments. Included in these tables are 
the results of the nonVespondent follovup conducted in Age Class 3 assessment. 

Session completion rates for regular assignments ranged from 98.8 po 
100.0 ^ percent. Session completioil rates^ for standby assi^ni^nts ranged 

* from 72.7 to 89.5 percent. Students assessed in rejgular assignments ranged 
'Ty ^ ' from 78.9 to 90.1 perc^t. ' Students assessed in standby assignments ^ranged* 

^ from 88.5 to 93.3 percent. ' s • \ 
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Table 2-63.. Summary of school response ia Year 11 sample ' > 

i 





41 






• i 














Aee 


Class 1 


\ Age 


Class 2 




Age 


^mfii. 

d\«s 3 


' Total Sample 






Percent 




Percent 






Percent . 




• 

Percent 


I- 

^ u 


No. 


of Total 


. No. 


of Total 


I 


0 . 


of Total 


No 


of Total 


Asse^^ment 
Conducted 


560 


92.1 


53A 


83.2 


412 


8A.1 


1,506 


86.6 




















Refused 


32 


, 5.3* 


' Al 


6. A 




A6 


• 9. A 


119 


6.8 


Liosed 


6 


1.0 


IQ 


1.6 




2 


O.A 


18 


1.0 


No Eligible^ 


10 


1.6 




8. A 




28 


5.7 


92 


,5.3 


Enrolled 








* 








/ ■ 




Other 


0 


0.0 


3^ O.A 




2-(t O.A 


5 


0..3 


Total Selected 


608 


100.0 


6A2 


100.0 


A90 


100.0 


1,7A0 


100.0 



— One school selected in the samplfe for the Northeastern Region was not in 
existence; also, two schools in the sample for the Central Region were found 
to be in non^araple counties and, thus, were eliminated from the Year 11 sample 
of schools. ' 



2/ • , ' 

- These schools* were found to be situated in a county outside of the PSU in] 
which they ve re selected and were dropped from the sample. ' \ ^^^^-^ 




I 



9^ — # 



c 
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Table 2-64. Summary of school cooperation in Year 11 sample 





. Age 
^ Class 1 


Age 
Class 2 


Age 
Class 3 


Total 
Sample 


No. of originally selected 
schools (A) t w 

f ' 


590 


623 


467 


1,680 


No. of original out-of-range 
or closed schools (B) 


. 8. 


16 


6 


& • 

30 


No. of. original refusal 
school^ (C) , ^ 


32 


41 


kU 


117 


. (A-B)-C ^ 
Cooperation rate ^^,g) % 


9A'.5% 


93.2% 


90.5% 


92.9%" 



-J . 



\ 



\ 



Table 2-65. Numbers and percents of sessions-'leaejpleted, pacHa^es 
administered, and students assessed 11 regular 

assignments • 









Group packages 








Sessions 
assigned 


Sessions 
completed 


Students 
expected 

to be 
assessed^ 


Students 
actually 

completioh 
rate^ 


(- 

Age Class 1 / 


Number 
Percent 


1,764 "1 
A* 2,380' 


1,764 ^ 
100.0 


32,200 


29,013 
90.1 


Age Cl^ss 2 


Number 
Percent 


2,^2 
98.8 . 

* 


A8,295 


A1,A88 
85.9 


Age Class 3 


•Number 
Percent 


2,455^ 

( ■ 

-6,399 

* 


2,A25 
98.8 


A6,627 , 


36,027 
78.0 


Total 

\ % — 


Percent 


■ 6,54^1 - 
,99 . 1 


127,4-22 

• 


- -106 , 5 2a^ 
83?7 



Adjusted to the lower of the number of students assigned to be assessed 
in each sample school or the number of eli&ibles enrolled in each sample, 

school. ^ * ' . 

----- ^ , . . * \ . . . 

2 

Completion rate for Age Classes 1 and 2 is ratio of .the number of students 
assessed to the* number of students expected to be assesse'd. For Age Class 3, 
it is (1) the initial, response rate (Ho. assessed t nb. expected to be assessed 
in the'initial sessio^ns) plus, (2) the percentage, of nonrespondent^ in followup 
schools times the followup response fate. ^ ' V 



•J 



Table 2-b6, Numbers and percents .oif sessions completed, packages 
administered y •and students assessed Year. 11 s^ndby 
assignments 



' Group packages 



Age Clas^ 1 
Age Class 2 
•Age Class 3 

•4 

Total 



Sessions Sessions 
assigned completed 



Student^ 
expected 

to be 
afsessed^ 



Students 
actually 
assessed 
completion 
rate^ 



'Number ' 


19 


17 ■ 


165 . 


146 


V Per cent 




89.5 ' 




88.5 












Number 


50 


40 


210 


196 


Percent 




80.0 


• 


93.3 


Number 


22 


16 


124 


112 


Percent 




72.7 




90.3 


x. 

Number 


91 


I 73 , 


499 


454 


Percent 




80.^ ' 




91.0 



Adjusted to the lower of the number of *students9 assigned to be assessed 
in eTach sample school or the number of eligibles enrolled in each sample 
school . . - ^ * 

2 > ' * - \ - ^ - ^ ... - 

Completion rate for Ag^ Classes 1 and 2 is ratio of the number of students 
assessed^ to <he number of students expected t'o be assessed. For Age Class 3, . 
it is (1) the initial response rate (t^. assessed t no. expected to be assessed 
in the iq^tial sessions) plus/. (2) the percentage of nonre^pondents in^folloKup 
schools 'times the followup response rate. 
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2.10 Accessibility Status of I7"Year-01d Nonrespoodents . 

\ • 
In Year 11, three noaf espondents per 17-year-old school were selected 

anjd a form was completed for them to determine whether they were accessible 

or nr\accessible , In nonfollowup schools, an initial package was selected 

^nd thre<? njbnrespondents were selected. In followup schools, a followup 

package waa. identifie^i from which ^the three nonrespondents were 'selected , 

The nonrespo'ndent package was identified on a separate package assignment 

form for eacH school. This form also included random numbers for selection 

of sample individuals. 

Nonrespondents to each nonri&spondent package were numbered down the 

right hand side 5>f the Group Administration Schedule (GAS). Some sehools 

noted that s^e^ected students were dropouts, transfers, or ineligibles after 




ERIC 



tpe nonresponse form and others were including them. To keep field proce- 
'dures simple, all dropouts, transfers, and ineligibles were numbered whether^ 
they were located before tt Sfter ^sse^SifieilPt A copy of th^GAS ^earoff 
Cjpntalning the numbered frame was mailed to RTI along with- the nonre^ondent 
^form. Selected nonrespoodents were identified by line number on the non- 
respondent forpo (see appendix (5) and by having ti^eir frame number circled on 
the GAS tearoff . All selected nonrespondents Who wtfre not-ed as transfers, 
dropouts, dr ineligible before assessment were lined otit and were aot 
included in the sample which was tabulated. All transfers, dropouts, and 
ineligibles after assessment were hot lined out and were included ^n the 

.....( . 

Table 2-.67 summarizes the results, of the tabulation of accessibility 

status for the sample of 958 17-year-old nonrespondents. Inaccessible 

students were* counted as those who were ineligible, not enrolled, teraporari- 

* * .ft 

ly away but expected rto return, temporarily away but not expected to return, 

X ^ vj 



tifbulati^on. 



Region 



Northeast 
Southeast 

t mi 

West 

Total 



Table 2-67. At«ssi 



ibility Status for Sample of Noarespoading 17-Year-Olds 




No. 
ineligible 



No. enrolled, No. enrolled, 

No attended more than temp, away, but 

not enrplled ^1 day in last 30 ? expect to return 



No. 

No. enrolled -don't 
not return Itnow 



4 


11 


200 


3 


9 






S 




3 


n 


■ 225 


13 . 


'139 ■ 


860 



0 
0 

n 

_8 
21 



13 
1 



n 

0 



_4- 
18 



4 ' 
0 



Total 
232 

m 

201 

2V3 
956 



Inaccess ible students 

> 

Iaeligit>le ; 

Not enrolled 

Temp, away - return 

Temp, away - not return 

Terap. away'- I don*t know 



13 
39 
21 
18 
_7 
98 



I 

M 
Un 
M 
I 



Percentage of nonrespondents who were inaccessible = 



98 



^ X 100 = 10% (No Show Study 21%) 
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and temporarily away ^nd not known whether they would return or not. A 
.total of 98 or 10% (98/958), of the tabulated nonrespondents were classifi^ 
a» inaccessible, I»the Year 10 pretest of this procedure for checking the 
attendadce status of nonrespondents , the inaccessible percentage was 13%; 
in the Ho-Show study conducted in Year 04, the percentage inaccessible was 
21%. 

It is possible that the decline in the percenta'^ inaccessible since 
Year 04 is due t6 implementation of procedures for . up^i^g the student 
sampling frame prior to sample selection. When the No-Show study Was 
conducted, the 17-year-old sample wa^ not selected early and updated. 
Updating the sample likely has rau%ed the schools to clean the lists more 
'thoroughly for inacce^sibles . 
^.11 Special Problems and Recommendations 

The followup procedures " implemented for 17-year-olds appear to have 
^ been effective in increasing the response rate to an acceptable level. 



Similar procedures should continue to be followed. 



i b J 



\ - * 



-153- 



REFERENCES FOR CHAPTER 2 



[I] Chromy, James R. and Anne F. Clemmer, Year 11 Primary Sample for the 
National Assessment of Educational Progress . ^ RTI Project 255U-1764, 
Final Report, June 1980. 

[2] Sampling Department Staff. Formulation of Age Class 2 Veights--NAEP 

Year 03 In-School Survey . Working Paper No. 4 (Revised), RTI Project 

No. 25U-688. June 1972. - — ^ 

# 

[3] Clemmer, Anne F. Formulation for Age 17 Nonrespondent Follovup 
/ Weights in NAEP Year 10 In-School Sample . (Revised)^ RTI/1772/00-01 I, 
July 1979. ' 

(4] Clemmer, Anne F. - NAEP Year 05 In-School Package Assigoaent Procedure . 
Working Paper.No. 4, RTI Project No. 255U-918, September 1974. 

[5] District Superv i sor Manual, Year 10 . July 1978. 

[6] Clemmer, Anne F., P*^. Lefler, and J. E. Richardson. NAEP Year 07 
In-School Package Assignment Procedure . Working Paper No. 1, RTI 
Project No. 255U-1379, January 1977. 

V 

[7] Final Report of Year 11 In-School Quality Check Activities. October, 
1980.< RTI/1967/00-01F. 

18] ClcOTer,^ Anne F. Year 07 S(^condary and Terti>„ry_j5arg)le Design for 
the National Assessment of Educational Pr<|gress . Working Paper No. 8, 
RTI Project Hd. 255U-1061, April' 1975. 

I 



C 



-154- 



3r SUPPLEMENTARY FRAME ASSESSMENT 



3-1 Overviev 

It is estimated that perhaps 9 to 10 percent of all 16-^ to 17-^-year- 
olds are not enrolled in secondary schools when the in-school Age Class 3 
assessment is conducted, and the Supplementairy -Fjame assessment is designed 
to collect NAEP data from a probability sample of this portion of the Age 
Class 3 population. For Year 11, the Supplementary Frame asse§sraeQt target 
population was operationally defined as individuals born in the . period 
October 1, 1962 through September 30, 1963, and not enrolled in NAEP- 
eligible elementary ♦^r secondary schools anytime daring March or April 
1980. Excluded from the target population were nonreaders, non-Englis)i 
speaking individuals, persons living out of the countiry , ' and individuals 
^emed , incapable, of giving meaningful responses due to mental or physical 
impairment. • • , 

As in previous years, the NAEP Age Class 3 in-sch<5ol sample served as 
the basis for the Supplementary l^ame d«ign. The NAEP Age Class 3 schools 

/ ' ' ' 

in earh ,of the 83 Year 11 PSUs wpre s^pnpled at a rate of one-half to iden- 
tify the Supplementary Frame school subsaraple. A total ^ 209 schools were 
asked to particiif^te for this phase clothe assessment by providing lists^ of 
potentially* eligible dificontinuers fo?. the three most recent school years 
and, for schools having twelfth grades, lists .of potentially eligible early 
graduates. Cooperation was received from 207, or 99 percent, of t^e 
schools asked to participate for list compilati-on. After receijJt froaithe 
schools, the discontinud^r and early graduate^ lists were screened to eli- 
minate persbns with ineligible 'birthdates^ and duplicate listings, and to 
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establish thjt final stage sampling frame potentially . eligible indi- 

yiduals for ^ch school. • A sample of 965 discontipuers and 131 early 

graduat,es was selected from the sampling frame. 

The field staff attempted to locate each of the individua^ ia the 

sai9ple and assess those found to be eligible. Respondents were given the 

opportuiiity to complete up to three of the assessment packages and were 

remunerated at the rate of $5.pO for one, $10.00 for two and $20.00- for 

i 

three completed packages. A total of 1,00A individuals, of about 92 p'ef- 

cent of those in the sample, were located for screening; 752 of thjese were 

determined to be eligible; and 651 participated. Respondents completed a 

total of 1,916 packages, or an average of 137 responses for each of th/e 

fourteen instruments, a yield of ab6ut 9.5 percent above the design goal of 

125 responses per instruraexit, 
H 

Survey weights, adjusted far nonresponse, were computed for the com- 
pleted paclcages and were delivered to National 'Assessment on magnetic tape. 
Summary tabJlatlons and other relevant documentation were transmitted 
concurrently with the weight tape. 
3,2 Saropl:\hg Plan Development • 

National Assessment provided the following initial specifications for 
the Year 11 Supplementary Frame assessment: 

i (A) • Out-of-school 17-year-olds were to be assessed from Age Class 3 
' school discontinuei; lists and early* graduate lists; » 

(B) The birthdate range definition for 17-year-olds in ihe Supple- 
mentary Frame assessment was to Qpincide with the definition 
employed for the Year 11 in-school asses^sroent; 

(C) A probability subsample of approximately one-half the NAEP Age 
Class 3 schools should be selected in the Year 11 PSUs ; » 

' • -1 ' 

(D) The sample should be designed to yield approximately 125 responses 
for each of fourteen packages; 
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(E) Respondents should be permitted to complete up' to three of 'the 
Age Class 3 packages. ' ; , 

The sampling plan for the Supplementary Frame a|/sessraent was developed 
in accordance^ with' the foregoing specifications based on the Year 07 survey 
experience and fexpected Year 11 results. 

The specifications called for 125 responses for each of \ the ^fourteen 
^instruments, or approximately 1,750 completed packages, in total. Respond- 
ents wcM expected to complete an average of 2^.90 paci^ages and the expected 
overall participation rate was 55 percent, hence, the ^sample was designed 
to contain 

^7^0 = • 1,096 



(2.90)(0.55) 

potentially eligible individuals, 

3.3 School Selection 
— <• 




. A half-sample of th^ NAEP Age Class 3 schools was selected in each PSU 
to comprise the Supplementary Frame school • sample . -Within each of the 
PSU?, the NAEP Age Class 3 sample schools were divided into tvTo sets, which 
were Balanced to the extent possible on the number of schools, size of 
schools,- SES strata, and 17-year-old enrollment. One of the two groups was' 
selected from each PSU with probability equal to one-half. The Suppjement- 
ary ' Frame schools vere designated^^ the school data files an^d on the List 
of Schools Selected for each PSU which were mailed to the District Super- 
visor prior to initial meetings with schoc^^principals . 
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' • Approximately half of the new schtslcs subsequently identified and 
\c|iosen for addi-tion to the NAEP Age Class 3 sample were selected for inclu- 
sion in the Supplementary Frame sample. The number of Supplementary Frame 
schools by regioa is presented in table 3-1. 



kJ 



Taile 3-1. Year ll Supplementary Frame sample schools by region 





Total ' 
S upp 1 e m eat a ry 
Frame schools 


Dropped ^ 
from sample 


NAEP 
•refusal . 


Asked 
to participate 


Hortheast 




2 


. 6 


45 


Southeast 


54 


• 4 . 


- 3 


' • ' «^'47 , • 


Central 


71 


2 


4 


65 


West 


61 


\ 


_7 




Totai 


239 


, 10, 


20 


• 209 



Closed, no Age C^ass'3 grade, ' or no eligible enroll'ment 



- * » 

- Since the total school sample for 17-year-olds adequately represents 

f 

the various subpopulations of inXerest, a 50 percent subsample of the 

schools, selected with equal probabilities, also is representative of the 
' • i 

subpopul^ipns . - 

3.4 Dropout and Early Graduate Frame- Copstructio ti and Sample Selection 
' Supplementary Ftame sample school? were asked to provide . lists of 
individuals whose birthdates .were in the. range which defined Year 11^17-. 
year-olds (10/1/62 through 9/30/63), and* who left school during any of the 
academic years 1977-78, i978-79, o^ 1979-*80. The listing' was to include 
students who failed to return to school following siimmer vacation and who 
were not known to have enrolled in another school. Di*ontinuers whose 
birthdates were unknown were also' listed. Not to'be incliided in the list- 
ing were itudents who reenj:e'red school and who wepe enrolled at the time of 
Age Class 3 assessfiient, n<yr students who transferred directly to other 
schools. For eacb listed individual, the last known address was pbtained, 
•Dd whenever possible, the birthdate and '^he 'parents' names and. address. 



- ■ Supplementary Frame sample schools, whiqh bad a twelfth grade were 
?sked to provide a list* of person^ whose bir/hdates were in the range which 

r 

definted.Year 11 17-year-olds, and who had graduated ptior to the Year 11 
Age Class 3 in-scbool assessment. Subsampling .was dsed for searching' 
school' graduate records for the desired early graduates in ;arge schools. 
Two of the four alphabet sectors A-D, E-K, L-I}, aad S-Z was selected using 
simple random sampling. In scho«|ls with more than 250 graduates per year, 
only the recordr^T^ graduates whose last names fell within either of the 
prescribed alphabet sectors needed to be searched for early graduates. In 
smaller Schools all graduate records were to be searched for the early 
graduates. For e«irly\raduates identified through this screening process, 
the schools were asked to provide addresses , birthdates , and parents' names 
and addresses. 

The school ' discontinuer and i^rly graduate lists were forwarded to 
RTI'S sampling stiff after receipt from the field. Receipt of the lists 
was recorded, and" a record was made of requested information which was not 
provided due to refusal, nonavailability, or other reasons. The lists were 
reviewed for legibility and adherence to list acquisition specifications, 
and any resulting problems or .questions were reported to RTI's National 
Assessment Administration Center for resolution. 

The discontinuer and early graduate list's from each school were cleri- 
cally scanned to identify ^nd delete ineligible individuals and duplicates, 
and, the edited lists were serially' numbered to facilitate sample selection. 

Since PSUs and schools were selected with probabilities approximately 
proportional to the estimated number of 17-year-olds, an equal allocation 
of .sample individuals to replicates was uged. The Year 11 PSU sample was 
. comprised of eight one-replicate PSUs ,^ ?1 two-replitfate PSUs and .four 
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three-rieplicate -PSUs. Therefore, the desired sample of 1,096 individuals ♦ 
could potentially' be allocated to ^ total of 162 teplicates, yielding an 
average allocation* of 6.77 sample Individuals per replicate. It was anti- - 
cipated, .^however , v that for- some PSUs no lists of discontinuers or early 
graduates would be submitted ^\ due eithex to ^1 sample schools refusing or 
reporting that their records disclosed no age eligible ipj^-viduals ^ It w^s 
also aat icipdted t^at some fi^rther loss wpuld be experienced due to cases ' 
in wh^ich .tl\e number of potentially eligible individuals reported would be 
less than the sample allocation for the PSU. Rather than fix a specific 
allocation of the sample l^tesed on prereceipt estrimates these anticipated 

) 

losses, an iterative allocation plan was employed. An initial allocation 
o/ the desired 1,096 sample cases to PSUs based, on number of replicates was 
performed incorpor-ating the listing results known at that-^ime. *Then, as 
the list compilation proceeded and specific instances of loss from the 
desired alloca^^iotis were identified, the 'sample allocation. was adjusted to 
assure that the target yield of 1,096 sample cases would.be achieved. This 
allocation adjustment procedure was repeated several times a& sample sel^- 
tion proceeded, with adjustmentsr being made only for PSUs in which student 
sampling was yet to be performed. 

In the final allocation, most one-replicate P^s were allocated 7 or 8 
cases; roost two-replicate PSUs were allocated 14 o.r 15 cases; and most 
three-repi^atc PSUs were ' assigned 21 or 22 cases. The final average 
replicate allocation- was 6.85 (1,096 t 160) cases, since in one two-repli- 
• cate PSU no sample was possible because all * three Supplementary Frame 
sample schools were NAEP» refusals . A reduced sample was necessary in eight 
PSUs due to listing shortages, and in these cases all listed individuals 
were included in the sample. 
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Within PSUs, the student sa^le was allocated to the two sampling 
frames (di-scontinuer-. lists and nearly graduate lists) using a, strategy which 
optimized the number of the scarce early graduates 'in the sample. In most 
PSUs, early graduates were included in the sample with certainty.^ Ifi order 
to cpntrol representation from both frames, however, early graduates were 
not permitted ^o constitute more than half a 9SU's sample- allocation, 
unless the total nurfber of potenti^ly eligible <^contiQuers reported for 
the pSU was. insufficient to fill out the specified sample al^ocatioii. 

Within each "PSU, the discontinuer sample was allocated to schools 
using a procedure which approximately equalized the overall inclusion 
probabilities of sample discontinuers in the PSU. A similar procedure was 
used for allocating the early graduate sample, whenever necessary. Simple 
random selection was used t^ specify sample individuals within schools. 

The described allocation and selection procedures wfere implemented and 
a sample of 1,096 individuals was seJect^d--965 discontinuers and 131 early 
graduates. A field instrument, the Individual Screening Questior^naire 
(ISQ), was prepared for each sample individual. Information entered on the 
ISQ included the individual's name, last known a-ddress, parents' names anQ 
address, iridividutfl's birthdate and date left school, as reported from 
school records. Any peripheral information provided from the school 
records which might have been helpful in locating the -selected individual 
*was also recorded. All sanfjple . selection and ISQ preparation was completed 
by June 6, 1980. ' ^ 

3^ Package Assignment / 

National Assessment specified that the Year 11 Supplementary Frame 
assessment be conducted using the 14 Y^ar 11 Age Class 3 in-schopl Reading/ 
Literature packages. Each respondent was^ to be permitted to complete up 'to 
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three packages, including associated 'package supplements. A background 
•questionnaire^ was to be administered- to each respondent prior to package 
adbiinistration to ensure its completion'. 

Package assignment specifications were provided by National Assessment 
and consisted of a listing of 110" ordered package triplets or sets, which 
conformed to a complex set of packaging, protocol constraints. Procedures 
weri to be iinplemented .by RTI which made, assignment of any of ;:he 110 
triplets to a respondent equally likel^y. , 

RTI's National Assessment Administration Center (NAAC) prepared a 'list 
of Interviewer ID numbers and the number of package sets 'to be Assigned to 
each. Using, these specifications, 1 , 100. package assignment labels were 
generated, divided into 32 interviewer sets. The package assignment labels 
were delivered to NAAC on April 29 for use in preparation of the field 

materials. i 

•I 

Each label designated the set of three packages to be assigned to a 
respondent and prescribed the order of administration for the packages. A 
unique four-digit number was -given to each iLbel and 'served to identify th^ 
respondent to whom the package set was administered. Package sets were to 
be ^ssisaed to > res'pbndents^ in the sequence of the Jabel identification 
numbers. 

The packaging protocol constraints yielded, an unequal probability 
allocation of packages. For three-package ^ifpondents , the prbbability of 
assignment of packages 1-3 was .0667; the probability of ass igmnent ' of 
packages 4-14 was .0727. For respondents '.wfab co^leted only one or two 
packages, the package assignment probabilities were much more unequal. ' 
3.6 Support of Field Operations 

Continuous sui#ort of the ^;ield operations was- provided during the 
.planning and conduct of the Year\l Supplementary Frame assessment. The 
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major tasks and activities performed in^support of field operations were as 
follows: 

^ • - 

(A) Review and update the field instrument (Individual Screening- 
Questionnaire); * ' ) 

(B) Production of package assignment labels; 

(C) Participation in training for the Supplementary Frame assessment; 

(D) Resolution of field questions regarding application of eligibi- 
lity criteria and proper completion of field instrument; 

(E) Review of completed field instruments. 
3.7 Weight Computations 

3.7.1 Program ^Development and Data Preparation 

Recommendations for the Year 11 Supplementary Frame weight computa- 
^tions and nonresponse adjustments were submitted^ to National Assessment for 
review. After approval, programming specifications for computing' the Year 
11 weights' were prepared and SAS computer programs were developed for 
implementation of the weighting procedures. 

Data appropriate to computation of Supplementary Frame weights wer^ 
assembled f rom the following sources: 

(A) Age Class 3 in-school data files; 

(B) Supplementary Frame assessment list acquisition records aqd 
sample selection records; 

(C) Completed Individual Screening Questionnaina* (ISQs); 

(D) Scored Background Questionnaire/package file. 

In preparation for weight computations, Individual Screening Question- 
naire data were edited and reconciled with sampling records and the Back- 
ground Questionnaire data. 

3.7.2 Veigtits for School Discontinuers 

Package weights were computed for the 556 out-of-scho^ 17-ycar-olds 
assessed from the school discqntinuer list sample a? follows: 



\ 
\ 
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/k . weight applicable to package-a responses given by - 

ijk(of) " discontinuer respohdent-k of school- j Of PSU-i; 



1 



1 



1 



P(Discontinuer-:ijk) F 



(A) 



1" 
P. . 



1 

A. 
1 



Z 



r,s 

(C) (D) (E) (F) 



P(a) 



(G) 



Definitions and computational procedures for the seven terms of the weight 



expression follow^ 



/ 



(A) 



. P(Discontinuer-i j k) 



?(PSU-i) 



P(Schbol-j |P9U-i) , 



J 



P(Discontinue"r-k | School- j) 



= overall sample inclusion probability 
for discontinuer-k of school-j of 
■ PSU-i; 

= P(PSU-i) -PCSchool-j I PSU-i) • (0.5) -D 
* •P(Di^continuer-k|School-j) , where 

= probability of selecting PSU-'i for the 
Year 11 in-school primary sample; 

= probability of selecting school-j for the 
Year 11 in-School assessment, given the 
selection of PSU-i; 



0.5* , = probability of selecting s<;hool-j for the 
SupplementJi^fy Frame sample, given its 
* selection for the Year 11 in-school 

sample; 

D. = probability that the alphabet sector , 
^ containing discontinuer-i name was 

listed by school-j; for a few Supple- 
mentary Frame sample schools wit:h 
anticipated large numbers of discon- 
tinuers, listing was done for only 
half the alphabet, based on discon- 
tinuers' last names; 

1.0 if schoal-j listed entire alphabet; 

0.5 if school-j l-isted a random half of 
the alphabet; 

= probability of selecting discontinuer-k 
from the lists provided by scnool-j of 
PSU-i, given the selection of school-j 
for the Supplementary Frame sample; 



'40 



"where 



/ 




Q. 



= number of discontinuers selected from 
, school-j tot the Supplementary ^Fratne sample; 



r 
n 

r. ■ 

0 

' > = I I B . where 



Icl 



- numbervof potentially eligible discon- 
tinuers identified from lists provided 
by scbool-ij - ' ' 

The veight terms involving the factors F . ^ , C^^^, P.j, A., and are 

adjustments for various levels bf nonresp^^nse, as follows: 

/ F = estimated proportion oi school-ij's 1977-80 

^ ^ - ij potentially eligible discpntinuers covered 

by the lists provided by the schoolj dis- 
continuer lists were requested for the 
three academic years^l977-78 , 1978-79, 
and 1979-80, but some schools did not - 
submit lists for all thre^ school years; 

3 



{ 



1 if school-ij responded for academic 
year-p (year 1 = 1977-78, year T = 
1978-79, aU year ^3 = 1979-80) by 
either providing a list of discon- 
I =1 tinuers or reporting that their 

P I records contained no potentially 

I eligible discontinuers for that year; 

ih-M.herwise , and 

B = the unweighted proportion of sample 
P schools* 1977-80 potentially eligible 

discontinuers who left. school duripg^ 
academic year-p (computed using only 
the data from sample schools providing 
complete ' information) ; # 

♦ 

1 if school-ij responded for all three 
academic years by either providing 
discontinuer lists or stating that 
their records contained no potentially 
eligible discontinuers, i.e.. 



ErJc 2')L 



3 *■ /■ . 

if I I = 1 for school-ij; 

' ■ / J 

0 otherwise* \ 
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X.. 



= number of potentially eligible discon- 
\ tinuers identified in school-ij who 
left school during academic year-p; 



= total number of potentially eligible * 
discontinuers identified frgjH lists 
* from school-ij. * 

The values of B calculated from the sample^Schools ' data and used in 
P 

computing the Year 11 weights are as follows: 

, Academic year-p 1(1977-78) 2(1978-79)' 3(1979-80) Total 



Value of B 



0. 136 



0.368 



0.496 



1.000 



(C)* c 



r.s 



M 



r.s 



J. . 



H. 



= the estimated proportion of potentially eligible discontinuers 
in region-r, SOC-s who are from school's which would participate 
for the in-school as^essmentT and the Supplementary Frame > 
assessment; 



N 

r,s 



where 



1 



J. . 



H. . 



P(School-ij) , • . 



and 



1 if sample school-ij responded fbr-the Supplementary Frame 
dropout list acquisition; 

0 otherwise 



= number of 17-year-olds in school-ij, estimated fr6m total 
enrollment and grade range; 



P(School-ij) = P(PSU-i)-P(School-j|PSU-i)-(0.5) 



r.s 



i C r,» j 



In Year 11 there were five levels of SO 



for iach o 



f the four regions, 



hence, there were 20 r , s-combinations . The computed C values are shown 

r.s 



in table 3-2. ^ 



■ sch0.1noaresponse. ad,ust.ea/by region and;^^^ 

Table 3-2. Values, of C^^^, scnop . 




}«^east (1) 

SoutheJ 
Central (3) 



West 



.. where- 




ijl^ I 0 otherwise . . " 

^ .iallv eligible discontinuers selected fron. 

■ • n . = nun.J)Sr of potentially- eiig ^ ^ 

/ scbool-ij; . , ■ ,e in 



R. 



J where 



2^ 



^ p(Discontinu<frrijl^)'^ij *^r,s 
.k e i 



, and 



« 



"'^ * . ♦.^♦-tic was detertniaed 



lo otherwise 

. . , ,„a C .» previausl, defined, .»d 

p(Discontinuer-iJK; . r,s 

1 - . 



(pj ••' Z ■ = estimated proportion of eligible discbntinuers in regipn-r 
^ who ~would complete olft or mare NAEP packages; 



, where 



X - - 



V... • E... 
ijk ijk 



. P(Discontinuer-iik) 'F. . -C 'P.-'A. 



, and 



E. 



ijk 



1 if discontinuer-ijk was deTtermined to be eligible; 

0 ^otherwise 

1 if discontinuer-ijk was determined to be eligible anJ 
completed one or more NAEP packages; 

0 otherwise 



P(Discontinuer-iik) , F... C .P.. and A. are as previously defined; and 

' ij ' r,5 ij 1 

Jjk_ 



r " . . , P(Discontinuer-ijk) -F. . -C -IV. .-A. ' 

1 e r j,k ^ ij r^s ij 1 

(G) P(a> = probability that respon^dent dis'continucr-ijk would complete 
package-a (a 1,..:,14), given that he completed C packages 
(C = 1, 2, or 3) ; these probabilities are shown in the table 
below; 




P(a)|C 


C 


1 


2 


3 


1/5 


- T" 

1/5 


1/5 


3/Uo' 


37110 


12/55 


■ 7/55 


12/55 • 


12/55 



\ 



A sphool weight, U. , was arlso computed for each dlscontinuer respond- 



ent as follows 



ijk P(DiscontiniJ^r-ijk> F..--C P.. A. Z * 



ij r,s ij 1 r - 



ERiC 



tel^/ of the weight expression are as previously defined. The school 



weights are those appropriate for weighting dat^ collected uniformly from 

"sP°°dents, such as Bacicground Questioniiaire *ta. ' 
3.7.3 Weights for Early Gradu/tes ' . ^ '' 

Package weights wq^ computed for the 95 out-of-school 17-year-olds 
J- 1 f'^o" the early graduate list sample as follows: " 

y 



^ijk(of) : weight applicable to package-a responses given by respondent 
early gra(^ate-k of school-j of PSU-i; 



P(Graduate-ijk) * t * * T" •. * P(^ 

• (A) (B) ^ (C) . (D)^ ' (E) (F) 



The terms of the weight expression are generally analagous to those 
used for computing discontinuer weights, but computational procedures vary 
for some. of the terms. Definitions of the weight expression terms fpllow: 

♦ 

(A) P(Gntduate-ijk) = ^ overall sample inclusion probability for 

^^rly graduate-k of school-j of PSU-i; 

P(PSU-i)-P(School-j|PSU-i).(0,^-Dj ^ 

•P(Graduate-klSchool-j) ; where 

P(PSU-i) =• probability of selecting PSU-i for 'the 
^^^"^ 11 in-school primary sample; 

P(School-jlPSU-i) = probability of selecting school-j for the 

Year 11 in-school assessment, given the 
selection of PSU-i; 



0.5 - probability of selecting school-j for the 
Supplementary Frame sampl^ given its 
• , ' selection for the Year" 11 in-school sample- 

* °j ^ ^ probability that school-j was asked to 

provide lists containing g'raduate-k ' s name; 
* small/ schools were asked to list' all early 

«r3<^"ates; large schools were asked to 
provide lists (if early graduates whose last 
"^"'^s weri: contained within two randomly 
selectt^d alphabet sectors from the following 
; ^ four:"^A-D, E-K, L-R, S-Z; * 

I' 1.0 if school-j listed entire alphabet- 
O . = j . 

ERIC . 0-5 if school-j listed a random half of • 

BBBHB • ^M;^ t-he alphabet; * 



y 



-169- 




P(Graduate-k | School- ij) = , 



a. 
1 



N. . 



where 



ERiC 



N. 



ij 



number of early graduates selected from 
. school-lj. for the- Supplementary Frame 
sample;. 

number of potentially eligible early 
graduates identified from lists provided 
by school-ij ; 

None of the Yespondipg^schools reported- only partial screenihg for 
early graduates in the . speoified period (January 1, to beginning of 

Age Class. 3 assessment in PSU) , so the weight adjustment term for 
incomplete response, ^ , vAs not required. 



(B) 



-Ikhe estimated proportion of potentially eligible 
early graduates who are* from schools which would 
participate for the in-school -assessment and the 
Supplementary . Frame assessment; 

where 



M 
1^ 



M 



H. 



P<Sfchool-ij) 



and 



ij 



P(School-ij) 



1^ if sample school-ij responded for the Supplementary 
Frame early graduate list acquisition: 

0 otherwise, ^ 

number of 17'year-olds in scBool-ij estimated from 
total enrollment and grade range; this quantity was 
used as a proxy measure for the'^number of potentially 
eligible early graduates in computing the nonre'sponse 
adjustment; ' 

P(PSU-i)*P*(School-j|PSU-i)(jO,5) 



N = 



'P(SchCol-ij) 



p. 



ij 



proportioo, of sample early graduates from school-ij 
for whom eligibility status was determined; 
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[ 

[ 



(D) 



ijk 
A 



k e i ^ijk 



where 



1 if eligibilfty statufiT'wAs determined for ^early 
graduate-ijk; 



/ 



0 otherwise 



number of potentially eli^gible early graduated, 
selected from school-i,j; 

estimated proportibn of early graduates wl^o are 
, in schools for which eligibility status- could be 
determined for some early graduate; 




Q = 



K. 
ijk 



. K. 
ijk 



P(Graduate-ijk)'C 



and 



1 if . > 0 for school-ij , i.e., if eligibility 

J status was determined for some sample early 
•H graduate from school-ij; 

0 otherwise 



PCGracluate-ijk) and C are as previously defined, and 

1 



(E) 



' R 
Z 



. p(Graduate-ijk)-C ' 

iiJ.k 

estimated proportion of eligible early graduates 
in region- r who would complete one or more NAEP 
packages; 
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Y 

r 



where 



V ■ • E 



J 

and 



. - . . ?T«raduate-ijk)-C-P, .-A ' 

1 if graduate-ijk was determiq^d to be .eligible; 

0 otherwise. 

1 if graduatc-ijk was determined to b'e eligible 
and completed one or more NAEP packages; 

0 Stherwise. 
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The remaining terms in the computational expression for X'^ are as previously 

defined; and ^ * 

* " ** 

V ' - 

Y = z z iiiE 

^ i e r .j,k P(Graduate-ijk) -C-P^-. -A " 

(F) • P(a) ^ probability that respondent early graduate-i jk* vOuId 

co^lete package-a, given that- he completed C packages 
CC = 1, 2, 3), as previously defined. 

A schooX .weight, U^^^, was also computed for each early graduate 
respondent as follows: ^ 

u . = \ '- J_ _1_ 1 1 \ ' 

ijk P(Graduate-ijk) C P A Z ' ""^"^^ 

terms of the expression are aS previously defined. The school weights are 
those appropriate for weighting $Jata ' collected uniformly from all respond- 
ents, such as Background Questionnaire data. ^ 
3. 7". 4 Weight Edit^ing and Tape Preparation 

The computational sequence for <^btaining final weights foc'discon- 
. tinuers and early graduates consisted^ several steps, as follows: 

(A) Computation of school weights atjjusted for incomplete school 
responses and nonpart-icipatiivg schools; v 

(B) . Computation of school weights adjusted as in (A), and adjiisted 

for nondetermination of eligibility ..status for iome sample indi- 
viduali^; i • 

(C) CoMutation of final schoo]^eigbts adjusted as in (A) and (B) , 
aria adjusted for noijparticipation of some eligible individuals;' 

(D) Computation of final package weights from final school weights 
The weights computed in each step of the sequence were edited before 

proceeding with the -next step to assiire the accuracy ^ the submitted ' 
•weights. Randomly sel(5cte'd weights at each. step were verified as ha^pg 
V been correctly computed by reproducing the calculations by hand. All 
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atypically large "we4^ghts were similarly verified. ' JListings, frequency 
tabulations and summary statistics were obtained for . final school- ^d 

package weights.. All discontinuer package weights exceeding 10,000 were^ 

If 

identified 4nd reasons for their^^^sual sizes were documented; there were 
no atypically large early ^^ate weights. Large weights Vere generally 



due to flower than usual wi^hin-school selection rates and/o^ respondents 
yho completed only offr or £wo of the assessment packages. 

.The Supplementary Frame weight tape was prepared- in accordance with 
the format established by RTI , National Assessment and Westinghouse Data-^ 
Score Systems (WDSS) for reporting all Year 11 weights. A backup cdpy of 
the tape was prepared for retention at RTI, and the weight tape was sent to 
WDSS on October 10, 1980. Concurrently,- appropriate documentation and 
sunmary tabulations 'were delivered to National Assessment. 
3.7.5 Level* of the Estimates 
'Population totals for out-of -school 17-year-old discontinuers and 
early graduates were cstimatbd by summing thfe Year 11 , Supplementary, Fram^ 
assessment adjusted sch^o^weights for respondents, and ahese estimates are 
shown in table 3-3 witL results from preceding year^.* aIso presented in 
the \ table are Census-based estimates of the survey populations and the 
proportions of the populations estimated by the survey data. ^ 

The Year 11 survey estimate of the disco(itinuer frame out-of-school 
17-year-old ^o^l^tion, 305,075, is 47.2 percent above the 'estimate ob- 
tained in the -last Supplementary Frame assessment conducted in 1976 
(Tear .07). This increase results directly^ from a significant rise in the 
average number of discontinue^ . reported by participating schools, from 
19.2 in Tear Q7 ttj'^36 .3 -"tn Year 11. Since there is do evidence that the 
discontinuer populatiob has shown an actual increase over this period, the 
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Table 3-3. Supplementary Frame survey estimates of populati^oD and 
Census-based population estimates, by -assessment jrlear 



. » * 

^ 


AC 

(1974) 


Oo 
(1975) 


07 

(1976) - 


11 
(1980) 


Survey estimates: 










17-yef r-old 
Discontinuers 


233,532 


223,908 


197,588 


305,075 


17-/ear-old 




i.j J ^ op 






Total out-of-school 
17-year-ol<|s 


250,072 


239,193 


*214,077 


315,100 


Census estimates: 










*17-year-old8 (000 "8)^^ 


4,241 


4,175 


.. A, 280 


4,100 


Eligible out-of-school 










2/ 

17-year-olds-- 


386,^79 


380,760 


390,336 


373,920 


Proportion of eligible 
population estimated by 
Supplementary Fir^me datrf' 


0.647 


0.628 


0.54g 


0 .843 


— : — / _ 












Frjom Current Population Reports, Population Characteristics, Series 
P-20. . . • 



1/ 
P- 

2/ 

- Computed as (Census 17 yr.-olds) x 0.095 x 0.96, where 0,093 is the 
estimated proportion of 17-year-olds not enrolled in grades K-l2 in the 
period 1974-1980, and 0.96 is the estimated proportion of 17-year-old^ 
eligible for National Assessment. \ < 
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larger average -iznier of names listed could he due to better record keeping 
,by the schools a-i more thorough list preparation for Supplementary Frame. 

The. Year 11 survey estimate, of the early gra^duate frame out-of-school 
17-year-old -^optxl^tion was 10,024, 39.2 percent, below the ^ear 07 estimate. 
However, the unweighted average number of early graduates reported by 
participating schools showed very little .change between Year 07 and Year 
11. Since early graduate survey estimates are based on very small samples, 
the observed year to year differences are likely within the range of sampl- 
* ing error . 

* The estimated total out-of -school 17-year-old population from^he 'Year 

11 survey, 315,100, is 84 percent of the Census based estimate and repre- 
sents the highest estimated level of coverage for any of the Supplementary 
Frame surveys. ^ 

3.8 DOC, TOC, an^ STOC Classification 

No separate determination of DOC, TOC, and STOC was made for Supple- 
oentary Frame respondents. Rather, the ojit-of-school 17-year-o^ds selected 
from a particular school wer* given the same DOC-TOC-STOC categorization as 
th^ respondents V for the^ Age Class 3 in-school assessment in t^t school. 
The DOC-TOC-STOC determination for Year 11 in-schooL respondents is dis- 
cussed in Chapter 2 of this reportr^ 

3.9 Response Experience 

] Response experience data for the Year 11 Supplementary Frame samfrte 
schools are'^esented in table 3-4 ^ while response experience for sample 
,discontinuer5 and Arly graduates appear in^/table 3-5. 

A total of 209 NAEP Age Class 3 schools were asked to participate for 
the Supplementary Frame assessment. As shown in table' 3-4, two of .the 
j schools * asked, or 1.0 percent^ refused to provide disconrinuer lists or 

EJiC . 211 



Table 3-4. Year 11 Supplementary Frame list acquisition results 



=^ — ^ 

Sample 


Year 
Number 


11 

Percent 


Year 07 
Percent/ 


Discontinuer Sample 








' Schools asked to provide discontinuer lists 


209 


100.0 


100.0 


Refused to provide lists 


2 


1.0 


5.7 


Participating schools 


207 


99.0 


94.3 ■ 


.Reported "No eligible discontinuers" 


33 


15.8 


28.3 


Provided discontinuer lists * 


174 


83.3 


66.1 


Early graduate sample 








Schools asked to provide early graduate^ 
lists 


205 


100. 0 


100.0 


Ketuseo uo paruicipauc 


2 


1.0 


11.1 


Participating schools 


203 ' 
*> 


99.0 


88.9 


Reported '"No eligible early graduates" 


147 


71.7 


67.1 


Provided early graduate lists 


56 


. 27.3 

■A 


21.8 ' 


. » ■ : 




* • 
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Table 3-5. • Year 11 Supplementary Frame a|5esstnent fipljl results 
lith comparatij^e percentage resi^lts for Year 07 



/ 



i. 



Year 11 Year 07 



Early Total Sainple 
Discpntinuers /OtHds. No. % 



Total Sample Persons 

.Persons with eligibility 
status undeteTTnined 



965 131 ^ 1,096 ^ lOO-^ 

88 4 ' 92 8.4 12.7 

6 ^.1.7 0.6 ' 1.7 



^^ Refused to provide screen- 6 

ing infonDay.on or unco- ^ ' . ^ 

.operative on all callbacks 

Coiild not locate or contact 82^ 3 85 7.8 11.0 

Person^ ^determined not * 237 15 252 23.0 18.7 

eligible' 

Ineligible birthd^te or ' 216 11 227 20.7 16.5 

enrolled at asses^sment 
^date ^ ^ • . 

'^Not living in U.S., 21 4 . 25 , 2^.3 2.3 

mentally or physically , ^ , 

* incapable, non-English % 

speaking or nonreader * ' 

Persons determined eUgible 640 ^ 112 7S2 68.6 68.fr 



0 

Refused to participate 
or uncooperative on all 
calls 



45 ^ 15 60 / 5.5 5.0 



Coulji not locate or contact ^39 



41 3.7 411 



Package respondents 556 95 651 59.4 59.^ 



Packages completed • 1,635 281 1,916 

Packages per respondent 2.94 
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• reptfrted that the ^ecessary records were not available. There were also 20 
schools selected in the initial Supplementary Fraie Subsaraple which were 
not asked to-participate for list acquisition due to their refusal for the 

- in-school -assessment (table 3-1). The overall school nonparticipatio'n rate 
for Year, 11, therefore was 

/ 2 + 20 ' , 22 

/2pTW 100) = C^^^^OO) = 9.6%. 

Of the 207 schools which agreed to participate, 33, or '15.9 percent, report- 
ed thalf their .records disclosed no age eligible discontinuers for the 
period' specified, i.e., submitted empty lists, while the remaining 174 
schools, or 84.1 per'cent of those participating, provided nonempty lists of 
discontinuers for at least one school year. A total 'of 7,081 potent\lly 
.eligible discontinuers was identified from the lists submitted. 

There were 205 Supplementary Fraae sample schools asked to participate 
which had twelfth grades, and these schools were asked to provide both 
disc«ntinuer and ear]> graduate lists. As shown in table 3-4, two.schools. 
or J.O per cent, >><fus*d to search their records for the early graduates or 
reported that the necessary records were not available. When rpfusals for 
in-school assessment are considered, the overall school nonparticipation 
rate for the early gi^aduate phas» of the study was: 
f 20 + 2 , ; 22 

^205 +- 20 " lOO)- = ^225 ^^^^ = 9. 8% .* ... 
Of the 203 schools which 'agreed to participate, 147, or 72.4 percent, 
reported that their records disclosed none of .the scarce age-eligible .early 
graduates within the specified alphabet se^ocs. Nonempty lists were 
received from 56 study schools, and these schools listed a total of 172 
potentially eligible early graduates. ' • * 
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Ta^e 3-5 presents the final results from the field location, screen- 
ing, ^nd package , administration. The sample, was comprised of 965 potenti- 
ally eligible di^ontinuers and 131 early graduates, or 1,096 sample indi- 
viduals^in total. For 92, or 8.4 i^ercent, of those in the sample, inter- 
viewers were unable to obtain* eligibility screening information. Failure 
to locate or contact' the sample individual or a close family member account- 
ed for 85i or 9^4 percent, of these cases. A tota^l o^ 252. individuals, 
23.0 percent of those in tlU sarqple, were determined to be ineligible for 
assessment. In 227, or 90.1 percent of these cases, ineligibility was due 
to an out-of-^range birthdate or to enrollment in school during the time of 
Year 11 Age Class 3 in-school assessment. The 252 individuals categorized 
as ineligible represent 25 . J percent of the 1,004 sample persons for whom 
eligibility screening was completed* A total of 752 individuals were 
determined to be eligible for the assessment, and 651, or 86.6 percent, of 
these participated. Nonparticipation was due to refusals in 60 cases, 
while failure to locate the individual accounted for the balance of the 
nonparticipating eligible individuals. The 651 participants represent 59.4 
percent of all sample individuals, this result is almost identical to the 
Year 07 overall rate of participation. 

The desired*package yield was 125 responses for each of the 14 packages 
or approximately ^1 , 750 completed packages , in total . Table 3-6 presents 
the number of responses obtained in the Supplementary Frame assessment " for 
the 14 Age Glass 3 packages, by sampling frame. Actual sufrvey response was 

1,916 completed packages, or an average of^l36.9 responses per instrument — 

♦ 

a yield 9.5 perceiit above the design goal. The package overage is primarily 
attributable to the higher-than-anticipated level of participation achieved 
in the study — 59.4 percent achieved versus 55.0 percent estimated in pre- 
suryey planning. 
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Table 3-6. Year 11 Supplementary Frame assessroeot package^ sample 
j«^i2e by student samjfliag frame 



Package 



Discontinuer > 
frame responses 



Early graduate 
frame responses 



1 


114 


2 


111 


3 


104 


4 


110 


5 


120 


6 


120 


. 7 


125 


8 


112 


9 


121 


10 . - 


116 


11 


119 


12 


123 


13 


120 


14 


120 


Total 


1,635 



18 
19 
25 
29 
21 
.22 
12 
21 
20 
21 
24 
15 
15 

281 



Total 
responses 



132 
130 
129 
139 
141 
142 
137 
,133 
141 

■ 137 
143 
138 
135 
139 

1,916 




ERIC 



216 



-l&O- 



^ ,n '^pr----' PrnhlPms and Recommendations ^, . ^ ; • 

*V '' \ problems encountered during conduct of* the 

There were no 'special problems en . 

- .^plemeatary Frame ^mplin^; and' weighing activities. • " " 

r ^ ^ . fh^ following recommendations are made 

L ^ Based %n Year 11 axperiefice. the following ^ 

r ' ' for future Supplemental Frame sampling: 

I ' ■ ' . •y.^A in section 3.4 for adjusting the 

(A) The iterative procedure describ^^in section 

r — n« to PSUs throughlhit list collection so as to 

|. student sample allocations, to PSUs cnr s 

,cMevr the desired total sample size should he employed. 
O ■ (B, Students w.o leave school du.Us MJ^^ ot April of .he current assess-^ 

k 1^ be deleted fro- the sampling frame as ineligible 
1- yment year shoul4 be deietea , 

y" • ^ (enrolled during March or April,, Such students were included in^the 

I ■ frame for Tear 1.. . since it was thought that schools might tend t. 

..tain discontinue's on rolls so«e ti«e past^tfeir actual date of 
1 . leaving sihool^ut .ear U field results did n« show this to be the 

^' . case, sample Zconti.Uers wit. March .r April'dates left .school were 

almost always clas;ified as ineligible during screening hy virtue of a 
1 • • ^ ' \ c^ion "Where you enrolled in.... school anytime , 

' "yes", answer to the ,q»jestion, Where y 

during^ March or April, 1980". 

. f ^h^ schools from whom lists were received report- 
. (C) A^ost 25 percent of the schools ir. _ 

' .,-Vr„Mnuers If Supplementary Frqme-, sample size 

ed 50 or more diBtontinuers . n aj 

' • ^ substantially increase^l in future assessments, 
requirements are, not substantially 

Ji ^ . • h uld be made to' allow subsampling by alphabet sectors for 

fi . ' provision should be maae to ax . , , 

.1 «e is done fpr early graduates, 

discontinuer list compilati^, as is iP 



f 
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APPENDIX A ' 
Year 11 Principa3.'s Questionnaire 
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SCHOOL PRINCIPAL'S QUESTIONNAIRE 



Approval Expires 9/30/81 



c 

{primary Sampling Unit 



► Thi. report i. .u«horiz«d by law (20 U.S.C. 1221 c ). WhH. 
vol « rx,t required «0 respond, your cooper.t.on t. needed^ 
lo m'eTh . resuU, of thi. .urv.y .o/npreher,..ve. .ccur.u.^ 
and limely. ■ 








School Number 


















J 



Group(s) 



9-Yt-Olds 13-Yr-Olds 12th Graders 



PLEASE 
PRINT 



1 



Name of School 



Address of School 




(CiTty) 

Name of Scho'ol Principal 

^^»^^r,o rhe form if other than school principal 
Name and title of person completing the torm 

^ Title 

Name / — 



1. 



grades not served by your school.) ^ 




I ERIC 



Grade 

Enrollment 

Average 

Daily -' ' < 
Attendii^irt 

• •, w n.rcentaee-of'the students' attending "your school live in each 
2. Approximately what percentage oi tne 
of the following areas? 

A In a rural area (less than 2,500> 
Z B In.a town of 2,500 to 10.000 
Z C ,In a town of IQ.OOO or more - 
. (Items A-C should add to 1^0^^ 



AOOZ 



Approximately what percentage of the students attending your school are children 
of 

t A Professional or managerial personnel 
<» 

Z B Sales, clerical, technical or skilled workers 



Z C Factory or other blue collar workers 



.% D Fann workers ' / 



E Persons, not regularly %ployed 



lOOZ 



Z F Persons ou welfare 

^^^^ ^ 
• (Items A-F should add to IOO5) 



Approximately what peJj^ntage of the students attending your school are 
Z A Ameritan ^Indian or Alaskan Native 
Z B Asian or Pacific Islander 



Z C Hispanic, regardless of race (Mexican, Puerto. Rican, Cuban, Central 
or South AmericaA or other Spanish culture or brigin) 



Z J> Black and npt Hispanic 



lOOZ 



1^ 

Z E White and not Hispanic 



(Items A-E should add to 100%) 



\ 



Does your school qualify for ESEA Titleyi assistance? 

Yes - If Yes, -approximately what number of students xjualify for 
and what nunberjhof students a-/e receiving ESEA Title I assistance? 



ApproJcim^te number of -students qualifying for ESEA 
~ lit\e I assistance 

_ Approximate number of students- receiving ESEA Title I 
assistance 



' No 




THANK YOU FOR YOUR COOPERATION 
I 



-7 



APPENDIX B 
Year 11 School Worksheet 



2l'l 



r 

r 
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SCHOOli WORKSHEET 



(Complete for each school for which you receive a , Package Assignaent For^) 
1 PSU Number School Number 

f J„"fia:ui« liili;'"' °" °' ^'^"^ - --o 

/\ A. How many students were identified by the school as: ^/ 

r , 1. Non-English speaking? 2\ EMR? 3. /Wtionally disabled? __ ^ 

L B.. How many names were crossed out for students: / • . 7 

1. With qut-of-jrange birthdates? . ^ 2, No Iqnger enrolled? 



F. 

• 



3. Who were ineligible for any other reason(s)? (Specify rea8on(s) in Part T.) 

• C, What was t|ie source used to complete SLF? > , ' 
D.« Sampling 

1. iubsamplin^ not used: 



y a.' Total count of eligible students listed on SLF 

2. Subsampling used: 
f 'a. Total count of eligible students listed on SLF 

^ ^ b. Enter sampling interval from Item 2 of Package Assignment B^ona b. ^ZIZ. 

c.- Multiply Item a. by Item b. 

» * c « 

E. Coipplete after packages have beep administered in the school. ~ 

l^' . ^t^^' No. Pkg. No!* ^ Pkg No 

Ho^ Completed Completed ^ No._. Complet^ed nT Competed 

t m 

. ^^I ^ ■ — ' — \ 



in'^irJLT P^"^^^"" "^^"^ sampUng-or obtaining Quorums. Ex^n in full when 
an assigned package administration is not givenr Indicate self-identified nonrLders 
by package and ID number.. (If additional space is needed, continue on a separate 
sheet, and attach to RTI copies.) e on a separate 



6. Coordinator 



District Supervisor: Date Completed: 

Disposition: White copy to MRCj-yellow and pink copies to RTI immediately iipdT"" 
9^- complet^n of .11 work in the PSU; goldenrod copy retained by dL. 
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APPENDIX C 
Year 11 Weight Tape .Format 



C-1 



National Assessment ol' Educational Progress 
^Ye.^^r 11 VJcigtit Tape 'Fnrmri;^ , 

(Prepared 12/27/79)\ / \ . 



I 

r 



Location * Hame Description 



•«-3 

» 

A-6 
7-8 



9 

19 

11-14 

15 
16 



PACKAGE 
PSUID 

School 



PSUSCHC 



INOUT 



STUDID 
STOC 



Age Gtoup Code: 1 9-year-old« 

2 13-year-olds\ 

3 17-year-olds;. ♦ 1> 
3 Supplementary Fr^e 

Package Number: 01,02. . . , I0,ll;12,i3,14,15 ' \ - ' 

PSU Numhp.r: (3-dlgit) Obtained as leading 26ro.art4 2-digit PSU 
number , - ' 

School Number:* (2-dlgit) Age Grouft 1*01-^9 

*Age Group' 2«*31-59 ' . . 
Age Group- ^5=61-89 V 

Chiek Digit: U-diglf) Check digit 1^ a fuVictlon of 2-digit PSU 
and 2-dlgit school nuiilber. \ ^ 

Supplementary Frame tape, type indicator: 0 9's,13's,17's in schoo 

r 

^ IJj^Slpple^cntary Frame ^ 

Assessee Number: 0000 9' s , 13' s ^17 ' s in scl^ol 

>0000 Supplementary^ Framer ' - 



Zero (0). 
ST0C:-^ 



1 • Extreme rural. 

2 Low metro 

3 High m^tro 

4 Main big city 

5 Urban fringe 

6 Medium city 

7 Small place 



17-19 COUNTY County (1970 FTPS code): >000 
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— ^TOC may be obtained fr««-STOC as follows: 

TOG: 1 Extreme rural STOC: 

2 bow metro 

3 High m'etro 

f . ^ 4 Othdts* 
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1 Extreme rural 

2 Low metro 

3 High metro 

4 Main big city 

5 Urban fringe 

6 Medium city 

7 Small place 



Lot;:ation 



Name Descriptlbip ♦ 



2(1^24 
25-26 



35-^7 
38-40 



ZIPCODE 
GRDLOW / 



27-28 . GRDHIGH 



. 29-34 PSU 



PRIN^IA 
PRINfllB 



4li43 • PRIN01C 

I 

4J.49 ^ 'PR1N(31E 
, 50-52 PRIN(31F 
53-55 TRIN01G 



See Federal iTiformation Processing Standards Publication ^ 
(FIPS PUB 6-1), Counties and County jtqu^.valents of , the 
States of the Unil:ed States^, U. S. DepartiDent of Commerce , » 
National Burea4i of • Standards , June 15, 1970. 



11? Code: >00000 \ 

Lowest Grade in School:-^ 00,01^ . ,11, 12; 00 - kindergarten, 
01 - 1st grade, 02 - 2nd gradej^etd. 

2/ 

Highest Grade in School:- 00 , OJ., . . . , 11 , 12 ; 00 
01 - 1st grade, 02 - 2nd grade,' etd. 



kindergarten. 



PSU numbers (6-diglt)j Six-digit PSU number 

is included because (1) it is the only place where sampling 
size of community (SOC) is reported; and (1) it will provide . 
similar PSU numbers when comparing data ^cross years. 

School Principal's Questionnaire Question 1: What is your 
best estimate of the average daily -attetidance by grade- of 
your school (1978-79 school year)? ^ , 

Kindergarten 

1st grade , 

\ \ 
2nd grade * , 

3rd grade \ ^ ' *. 

4th grade ' # 

^th gr&de 

6th grade ^ % ' 



2/ " * * * 

— A gr^e range will be supplied- for every school. In most casesi, the grade 

range ie obtained from the principal's Questionnaire. In those rare instances 

where this information is not provided on the Principal's Questionnaire, the data 

are iapiited from education directories. 



■ .^.^ 

Special cases \ 

L 1 


^ Location 25-26 


Location. 27-28 


A^^chool having 6th grade only 


06 / f 


06 


Ji school \JltH split grade range 






of 1-3 and^5-6 


01 


06 



r 
r 

z 

r 

i" 

0 



Location N^ame 
56-58 ' PRIN^IH 
59-61 • .PR1N01I 



62-64 
65-67 
68-70 
71-73 



83-85 
86-88. 
89-91 
^2-94 
95-97 
98-100 



PRIN^IJ 
PRIN01K 
PRIN01L 
PRIN01M 



74-76 PRIN(32A 
77-79 PRIN(32B 
80-82 PRIN02C 



r 



PRIN03A 
PRIN03B 
PRIN03C 
PRIN03D 
PRIN03E 
PRIN03F 
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Description 

7th ^ade I * ^ 
8th grade 

9th grade ^ ' - ' . 

10th grade 
11th grade 
12th grade 

Average daily attendance is reported to nearest percent. 
Locatioris 35 through 73 ^r^zeto if average daily attendance 
is not reported. 

School Principalis Questionnaire Question 2: Approximately 
what percentage of students attending your building live 
in each of ^ the following areas: Zj % 

Rural area (le&s than 2,500) 

Town of 2,500 to 10,000 

Town of 10, poo or more 

Sum of values is 100. 

School Principal's Questionnaire Question 3~: Approximately^ 
what percentage of the students attending your building are 
chiidren of 2/ ^ 

Professional or managerial personnel j 

Sales, clerical, technical, or skilled workers , 

Factory or other blue collar workers 

parm workers * * - . ^ 

Not regularly employed . 

O^y- welfare 

> ; 

Sum of values is 100. 



erIc 



' 3/ • ' 

^ — When this information Is not supplied on the Principal's Questionnaire, 

it is imputed using Census data. - * * ^ 
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n 



Location Name Description 



101-103 PRINa^A 

lOA-106 PRIN9AB ■ 

107-109 PRIN(JAC 

110-U^ ?RINOAD. 

113-115 PRIN0i.E 



116 PRIN05A 



117-120 PRIN05B 

121-12A PRIN05C 

125 STANDBY 

< 126-130 SFOPCNT 

131-139 STSWGT 



J.40-1A8 



WEir.HTT 



1A9-150 ELIGCNT 



151 



DOC 



School Principal's Questionnaire Question A: Approximately . 
what percentage of the students attending your school are _3/ 

.American Indian or Aldskan Native ■ 

Asian or Pacific Islander 

Hispanic, regardless of ra^ce ( >texican, Puerto Rican, Cubin, 
Central or South American or other Spanish culture or origin) 



/ 



Black and not Hispanic 
White and not Hispanic 
Sum of values is 100, 



School Principal's Questionnaire Question 5: Does your 
school 'qualify for ESEA Title I assistance? 



0 , "No respons 

1 Yes 

2 No 



If yes, approximately what nuniber-of students qualify for and 
wha^ number of students arc receiving ESEA Title I assistance? 

Approximate number of students qualifying for ESEA Title 1 
assistance. 

Approximate number of students receivifig ESEA Tit^e I assistand'e. 

Type of package: 0 Regular 

1 Standby 

Number of stucJents in student sampling frame as reported on 
School Worksheet: 00000 Supplementary Frame 

>00000 9's,13's, 17's in school 

Reconciled, regular assessment student-level school weight to be u 
when data file ' contains one record per s tudent (F9 . 2) ; >000000000 

Reconciled regular assessment package weight (F9.2): 
>000000000 

Number of regular eligible respondents (i.e., respondents in' 
.correct age domain, non-EhlR, English speaking, etc.) or number 
of eligible respondents to f ollowup assessnfent . 



00 • Supplementary Frame 
>00 JMI others 

D0C: 1 Big city 

2 Urban fringe 

. 3 Medium city 

.4 Small place 



00^ 
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Location Name. Description * " 

. 152 FRAME Frame: 0 9'8, 13's, 17's m school .'^ 

2=b=Age Group. 3 school dropout list frame * 
3=h»Early graduate list frame 

153-154- -STATE ' State c,de (1970 FIPS code) : >00 (For Supplementary Frame 

study, the. State code was obtained from the school which " 
provided the original dropout list.) See attachment for 
definition of State codes. 



155-159 STOTCNT 



160 SPUBPRV 



161 SES 



162-165 ' ISVARES 



166 y REGOBE 



School total ^ollment: >00000 (For Supplementary Frame 
Study the total enrollment was 9btained from the school which 
provided the original dropout list.) 

Public/Private school .code: (For Supplementary Frame Study, 
the public/private school code was obtained from the school 
which provided the original dropout list.) 

1 = Public 

2 - Private Catholic 

3 = Private Non-Catholic 

•Socioeconomic Status (SES) School code: (For Supplementary 

nr^^. ^ I' '^^ obtained from the school which 

provided the original dropout list.) 

^ " SOC rrPSUs^*"^" ^""^ ^'^'^ extreme rural for 

2 = R^njainder of city for SOC 1,2,3 PSUJ not applicable for 

3 - Remainder of PSU for all PSUs. , . , 

mpnt^^^°i variance estimatio^n code for PSU^chool. (For Supple- 
mentary Frame study, the in-school. variancf estimation code was 
obtained from the school which provided the original dropout Ust. 

abbe where ' 

a - PSU-school regional code (1, 2, 3, A, 9) 
bb - stratum within region 

c - replioate/within stratum and region. " • - - 

PSU^schools with same region and stratum within region code are 
to be paired for variance estimation purposes. In some cases, . 
there may be three mertibers in the group. 

Office of Business Economics (OBE) regional code by school. 
(For Supplementary Frame, the OBE regional code and Census 
regional codes were obtained from the school which provided 
the original dropout list;) 

1 - N6rth Atlantic 

2 ■ Southeast 
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Location Name resccrlptlon 



3 *^ Great Lakes and Plains 

4 = West and Southwest 
(Seee attachment for States 



in these regions.) 



167 REGCEJj Ceirssus regional code by school 



168-169 INELCNT 



1 = New England . 

2 Middle Atlantic 

3 =^ East North Central 
A »= "West North Central 
5 «= South Atlantic 
6'= East South Central 
1 »= West South Central 
8 =^ Mountain 

■ 9 -= Pacific 
(Se=s attachment for States in these regions.) 

Num-^r of ineligible respondents to regular assessment 

:-:hT'°w'"'' ^"""ect age domain. EMR. non- 
t"o^?:no:^rassI;s::n;! - °^ ineUgibIe;respondents 

00 Supplementary Frame 
>00 



170-176 LEACODE 



Loc^l Education Agency (LEA) codes V * 7 ^ 
developed by the National Center f^r FH : "'^^ 
(NC-S) which uniquely identifies oubM Statistics 
witr.in each State (For' n^, ! ^ ? districts 

The first two digits Irthe lE^ 'T''^^' "'^^ 

the last 5 digit! ^den1lf5^^e^i^ti '"^^ ^"^ 

For Supplementary Frame Study the lEA coH . 

for the school which supplied 't^e oriein"?^ 

>00'.0000 HFi-i-ea cne original dropout list. 



177 SEVENI 



178-186 SCHWGT 

Internal Labels: 

DSN-RTI.WT.a.Yyy 
where a^age 



0, if regular 17-year-old respondentor g or- n u 

1 -1 1-7 1 J ==H"«'uentor y or 13-year-old respondert 

1, It initial 17-year-old respondent; =H"«'ueRc 

2, if n-ytar-old followup respondent. 
Reconciled regular assessment School-level srWi 
u.ed .at, me contain, one r:co;rpe\MH°ool1^^^1^000< 



N-9s 

T-13S , ~ ' / 

Tuo'i^""^ '"'^ nonrespondent followup 
0-1 7s Supplementary Frame. • 




yy - Assessment Year. 



ERIC" 



^^For a list of th6« codes, see Universe* of Ooeratinc anH n 
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STATE CODES 



OMITT^ DUE TO CONFIDENTIALITY 



ERIC 
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1 ; 



U.S. Office 6f Business Economics Regions 



Atlantic (1) ^ 



Connecticut * 
1^ Delaware ^ 

IXistric^ of (^RJjmb^a 
* Maine 
Maryland* 
Massachusetts 
• New Hampshire 
Hew Jej^sey 
New York 

Pennsylvania r 
Rhode Island 
Vermont - O 



South 



e6st ( 



Alabama 
Arkansas 
Florida 
Georgia 



^^tntucky 



iJbuisiana 
Mississippi'^ . 
North Carolina 
South Carolina 
Tennessee 
Virginia 
West Virginia 



ip rcat Lakes and Plains (3) * 

[llinois 
[ndiana ' 

lidWLg^SL. 
linnesota 

lissburi 

iNebraska ^ 

jNorth Dakota 

I Sou eh Dakota 
^ Wisconsin 




West and Southwest (A) 

Alaska 
Arizona ^ 
California 
Colorado • ✓ 
Hawaii 
Idaho 
Montana 
Nevada 
New Mexico 
Oklahoma 
Oregon' . . • 
Texhs 
Utah ' 
Wn/^lngton 
yfyoming 
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.) - 
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Census Regions 



r- 



^Nev England (1) 

Connecticut 
Maine 

Massachusetts 
New Hampshire 
Rhode Island i 
Vermont 

East North Central (3) 

Illfnois 
Indiana 
Michigan 
Ohio 

Wisconsin . 



South Atlantic (5) 
Delaware 

District of Columbia 
Florida ' . 

Georgia 
Maryland 
Nortfy Carolina 
South Carolina 
Virginia ' , 

Vest Virginia 

V/est South Central (7) 

Arkansas 
Louisiana 
Oklahoma 
Texas 



Plrific (9) 

Alaska ' 

California 

Hawaii 

Oregon 

Wdshiogton 



Middle Atlantic (2)' 

New Jersey 
New York 

Pennsylvania ^ 



West North Central (4) 

Iowa ^ 
Kansas 

Minnesota * 

Missouri 

Nebraska 

North Dakota 

South, Dako^ia 

East South Central (6) 

Alabama 
J^entucky 
Mississippi 
Tennessee 



Mountain (8) 

Arizona 

Colorado 

Idaho 

Montana 

Nevada 

New Mexico * 

Utah 

Wyoming 



1./ *V 
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PSU Control Sheet 



OMITTED DUE TO CONFIDENTIALITY 
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APPENplX G 
' Ap p, Clasa -Nonrespondent Form 




AGE CLASS 3,N0NRECP0NDENT FORM 



Please 

answer 
Please 



PS 


U SCIIOO 















Form Appfovfd 
FEbAC No. ^ 34 
Appfoval Expirn t2/8t 



Package number 

Administration Schedule Letter 
Line ntdiber 



comp 

and 

expl 



letk the diagram below concerning the student whose name appears on the label. Check the'appropriat 
folli^w the arrows until you reach a STOP sign. Shade the oval in the STOP sign with a no. 2 pencil, 
in atnr unusual situations in the eomraents section. ' 




Is thi^ student EMR, functionally 
disable^, or non-English speaking? 



— ) No Q 




Was this student officially enrolled 
in this school at the time National 
Assessment was conducted? 



Yes 



ComMnta 




□ 



Did this student attend more thsn 
one day of school during the 30-day 
period preceding National Assessment testing? 



la this student temporarily away from 
school (i.e., suspension, Illness, injury, 
travel, ert.) but expected to returiiT 

r~ 

□ Ye. • 
i 




l-T^ T — 

□ no n I don't Unow 

I I. 



Fpt« co^lattd by 



Title 




ciljSTOP 



Date 



Sign flret font co«pleced wltl, name, title, and dAte. 
peopU are co^>letlng £or«a. 



DO NOT algn additional foraa unleaa aeveral 
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